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(54) A three-dimensional virtual reality space sharing method and system 



(57) Volume of communication necessary for dis- 
playing moving images is minimized. When an object is 
moved on a client terminal (13-1), a message indicating 
the movement of the object is transmitted to a server 
terminal (11-1). The server terminal (1 1-1) transmits the 
message to client terminals (13-2 and 13-3). Each of 
the client terminals (13-1) through (13-3) stores a mes- 
sage table in advance to execute the message. Accord- 
ing the message table, an image for locally moving an 
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object (101) is generated and displayed. This novel 
setup transmits information about the update of an 
update objects composed of a plurality of sub objects 
each of which state is subject to change, in a minimum 
transmission volume. This, in turn, allows cooperative 
operations of the plurality of sub objects to be smoothly 
displayed in a three-dimensional virtual reality space 
shared by a plurality of users. 
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Description -arayr. •"" r -° : ' ; : '""' Tn 

BACKGROUND OF THE INVENTION ' • \ . Vi-r .V , --.^ <1:.--cv:' ' r - 

The present invention relates to a method of sharing a We^dimensional virtual reality space; a system of sharing 
a threeklimensional virtual reality space, a . method pf information processing,, an informatiprv. recording medium, a 
method of information recording, an irrformation-tf admission medium, a method of ir^rmatipn.transmiss.on, a client ,: 
terminal 1 and a shared server terminal and.,more particularly, tea method of fharing a three^imensipnal virtual realrty 
space a system of sharing a three-dimensional virtual reality space, a method of information processing, aninfprma- 
tion recording medium, a method of information recording, an information transmission. medium, a method of informa- 
tion transmission, a client terminal, and a shared server terminal which^are suitable for : generatirga virtualreal^y space 
for example to be provided to users. r-t -. si^v ; ? ' = >" '■ '•>' ; ; f: v"'- %i 

A cyberspace service named Habit?.t (iredemark)-is known in; the so-called personal opmputer communications ^ ; . 
services such as;NlrcT^ Serye (trademark of Japan and ^ 
connect their personal computers vfe modems and public telephone network to^ 

ers of the services to access them in. predetermined protocols;- Development of Habita^started in i ess by LurasP.lm, .. 
of the US operated by Quantum Link, one of US commercial networks, for about three years. Then,: Habitat started its , 
service in NIFTYServe as Fujitsu Habitat(tradern-»rk) in February 1990., In Habitat, users can send their alter, egos 
called avatars (;he incarnation of a god figuring.in . the Kindu mythology) into a virtual city called ,Populopol.s drawn by 
two-dimensional graphics to have a chat (namely, a realtime conversation, based on. text entered and displayed^.th ; , 
each other For further details of Habitat, refer. -to the Jaoanese translation of. "Cyberspace: First Steps." Michael Ben, 
edikt. ed., 1991, MIT Press Cambridge, MA, ISBN0-262-02327-X, the translation being published March 20. 1994, by 
NTT Publishing, ISBN4-87188-265-9C0010, pp. 282-307. ■ : : ' ' 

In the related art cyberspace system operated on such personal communications servers as mentioned above, a 
virtujJSsfeel a virtual room interior, and the like aredrawn in two-dimensional graphics, |n such an environment, move- 
ment ov an avaiar. backward or forward is realized simply by moving it up or down in a two-dimensional background, pro-, 
viding poor representation for enabling the user to experience walk or movement -in. the viti'al spacer Because^ this 
scheme makes the user look at the virtual space in which the user's avatar and another user's avatar are .shown from 
the viewpoint of a third, person, the sense of pseodo experience is marred to a large extent. Therefore, realization of the 
walk-through capability has been awaited by the industry concerned., in which the virtual space is displayed m ffiree 
dimensional graphics and an avatar canwalk freely in the virtuafspaee ; from the viewpoint, of avatar itself. thus enhanc- 
ing Hie sense of pseudo- experience.' . '■<..•. ,!'! :.; •'. ' ""- ' ''"z.J'-JL ' 

On the other hand, for a related art example for, realizing the sharing of: a three<limens.onal virtual reality space , on 
a network, a system of FIG. 42 is known which. is constituted by client termina!s: ; 3-1 •through [3-3 interconnectediby the ••• 
LAN (Local Area- Network) installed in companies or laboratories. .-..!<• . fj r ;>-.:-i.V jt«'-> 

Rrst all client terminals 3--1 through 3-3 read graphics data ; from astorage^eytce^of a server.yterrriinal Whafr 
describe the same three-dimensional, space to display the.same three-dimensional space -At this pcinf of t me„th? : 
three-dimensional spaces visually recognized by .all users match each other. Namely, the client termfnals 3,^ougli. . 
3-3 show three-dimensional images according to the;viewpoints.of.the users : of1hese terminals as shown in-F.es. ,43 ,- 
A through 43 C. In this example.. a triangular pyramidal objects Of. ;a<quadrangular prism object 102; anda cylindrical 

° bie Me 1 amwhile if at a client terminal 3- 1 .the user changed positions of the conical object 1.01 .information about the 
change (changeinformation) is sent from the client terminal 3-1. to .the server 1 via a LAN .4, The ,clianse;.nforrnat.on r 
about -the* movement- is theniransmitted from the sender terminal -.1: via the LAN 4 to the client terminals. 3-2 and 3-3, 
Then/on the client terminals 3-2 and 3-3. the display, position of the conical object. is changed according to.th.e change 
information transmitted from the client terminal 3-1." : ) ;> ■ 

Likewise when, on the client terminal 3,2 or 3-3. an operation is made to move the quadrangular prism object .1.02 
or the cylindricalobject 103. an imageiirv which the quadrangular prism object 1 02 or the cylindrical object 1 03,has been : 
moved accordingly is displayed on ithe clientterminal 3-1. _ . ■< ■■■■■.u- : 

To be more specif ic; when a change is made to the virtual reality space on any of the client-terminals 3-1 Jirougt: 
3-3; the change is reflected in the display of the other client terminate;, thereby allowing the users of the client terminate. 
3-1 through 3-3 to share the same virtualreality space: • -: : 5 , • * ' ' uJ 

The above-mentioned objects 101 through .103 and avatar objects representing the users.can be moved, wrthm ? 
virtual reality space and made enter or exit the virtual reality space, the states of the objects being changed (or.updated) 
insidethe virtual reality space. The objects that can change their.states are hereinafter-appropnately referred to as 
update objects. Unlike the update objects, objects representing buildings for example,which constitute* town in. a w- 
tuaUeality space are commohly used by a plurality of users, the basic states of such objects remaining , unchanged. 
Even if their states change, such a change is autonomous;, namely. the ; change takes place independently^ the oper- 
ation made on a-client terminal. These objects which are used by a plurality of users are. hereinafter appropriately. 
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referred to as basic objects. •*;.*.;* 

Meanwhile, in the system for sharing a three-dimensional virtual reality space by using the LAN as shown in FIG. 
42, if objects 101 through 103 each having a simple shape consisting of a single object as shown in FIG. 43, it can be : 
implemented by transferring the identification numbers of the objects 101 through 103 and the update information 

5 including shift vectors of the objecto : 101 "through 103 fcf--ex^rrijDle. ' . v y v. ■ T 

However; moving air objdct having a cdhpiex shape obnsisidng of a plurality of sub objects has to trarsfe. the iden- 
tification number and Ujxl<it& information of each sub object separately, thereby increasing the traffic through the LAN:, 
andcielayihg the transmission of each update information; resulting in a mismaici'i between .the movements of the 
objects disjjlayed on the : ci;ent terminals 3-1 through 3-3, a delay in a plurality of sub objects, and eventually in a jerky : 

io movemeni: in a series of iriverlo^ -v' . • >* :^ 

For example^FiG. 44?sHows principles of operation of representinc,-foe walking behavioi of an avata: simulating a 
user in a three-dimensional virtual reality space. In this example, the avatar object is constituted by a total of five sub 
objects; a body : including a nead; a right Wm, a left arm, a right leg, andaleftJeg.'To make the hands and the legs of 
this avatar swing to-provide a walk behavior along with the movement of this avatar,: it isreiquired to transmit the update 

is information at least including the shift vector of the body sub object/ the shift vectors o?tlie right-arm, left-arm, right-leg 
and left-leg sub'objects, thefluctuation^an^le-from the axis providedby the joint to the body, along with the identification 
numbers of the sub objects.*^- t ...V ? : y . : 

Consequently; the number of sub objects constituting each object increases. Therefore,. as:a movement involving 
more complex operations is expressed, the volume of communication for transmitting the upcJafe information of objects : 

20 increases, thereby increasing the load to the server terminal 1 and decreasing the smoothness of the.display of the 
movement of the object represented by the cboperativeoperationsof the sub objects. ' : ^ v - 

SUMMARY OF THE INVENTION ■ - - IV ,;:(•.:: 

25 It is therefore an object of the present, invention to provide a method -of sharing a three-dimensionalvirtual reality; 
space; a three-dimensional virtual reality space sharing system, a method of informationprocessing, an information, 
recording mediunrii a- method of information recording, an information transmission medium, a method of information 
transmission, a client terminal, and z server terminal for transmitting, in;a minimum quantity, the update information of 
an update object composed of sub objects of which states are subject to change and smoothly displaying a cooperative 

30 operation of these 'slib objects in a three-dimensicriarviYtual reality space shared by a p^ . 

In carrying out the invention and according to-a first aspect thereof, a method of sharing a three-dimensional virtual 
reality space comprising the steps of: connecting a plurality of client terminals for displaying athree<limensional virtual 
reality space including ah update object-constituted by a plurality of sub objects each of which state is subject to change 
to ashgted servfer terminal for controlling a state of the update object on each of the plurality of client terminals via a 

35 communication network; registering in each of the plurality of client terminals in advance a change sequence table for 
defining f ^'relationship between a SeqOence of changing 1 the state of each of the plurality of sub objects according to a 
change to the state of the update object' and a message for specifying?^ type of the change sequence;, when the state 
of the update object ISdrttrblied by the shared server terminal isupdated, notifying each of the plurality of clientterminals 
of the rneSsaigef corresponding to updated content of theistate of the update object from the shared server terminal; and : 

40 changing oh'eafch of the plurality Of client terminals the State of elach ofthe plurality of sub objects based on the change : 
sequence specified by the message to reflect the change in the displayed three-dimensional virtual reality space., ' 
In 'Carrying out thfe invention and according to -a second:aspect thereof, there is provided, a system of sharing a 
threendimensiohai virtual reality space comprising: a plurality of clientterminals for displaying a three-dimensional vir- 
tual reality space including an update object constituted by a plurality of sub objects each of which state is subject to, 

45 change; : a shafedserver terminal for controlling a state of the update object on each of the plurality of client terminals; 
a communication network for connecting each of the plurality of client terminals to the shared server terminal; and a, 
change sequence table for defining a relationship between a change sequence of the state of each of the sub objects 
corresponding to update content of the state of the update object and a message for specifying a type of the change 
sequence, the change sequence table being registered in each of the plurality of client terminals in advance; wherein, 

so when the state of the update object controlled by the shared server terminal is updated, the shared server terminal noti- 
fies each of the plurality of client terminals of the message corresponding to updated content cf the state of the Update 
object, and each of the client terminals changes the state of each of the plurality of sub objects based on the change 
sequence specified by the message to reflect the change in the displayed three-dimensional virtual reality space.-.- ; 
In carrying: out the invention and according to a third . aspect thereof; there is provided an information recording • 

55 medium for use in a three-dimensional virtual reality space sharing system to record a. computer program comprising 
the processing steps of : connecting a* plurality of client terminals for displaying a three-dimensional virtual reality space 
including an update object constituted by aplurality of sub objects each of which state is subject to change to a shared, 
server terminal fbrcontrolling a state of the update object on each of the.piurality of client terminals via a communication 
network; registering in each of the plurality of client terminals in advance a change sequence table for defining; a rela^ 
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tionship..t>otv»ern a sentence** changing the state of each of the plurality of sub objecte ^ccor^ing.to.a ql^ngf^Q the ;r , 
state of Ihe update ob ; 3f.-anJ a message for specifying a Woe of the ; change sequence; ^ *. 
obje^pontrolled by :tfie shared server terminal is updated,. notifying ear h : pf theplura!^ mes v . ; 

sage corrosppnding tr LC 'feted content^ the st9t j of the update object from.the shared server terminal; ancj changing r! 
on each of the plurality of client terminals the state of each olthe plurality of sub cbjegts based qn 1^ changp sequence,: 
specified by the message to reflect the change in the displayed. ,three<Ji.mensional virtual re^rtv space; wherein the 
computer program is readable and Reputable by ai leas? one of the ;ier^ri^^ server terminal 

and the plurality of client terminals. r - ; .. >, r< ^ % «< ;r^..f,^j>; ■ *. vxs*;: i '■<•''*• 

In carrying cut the invention and> according to -a fourth. a§p^ : mered,,there jspcovided an. M^^oni^r^m^ . 
method for use in a three-dimensional virtual reality sharing system to record a computer, program in an infbrmation. j; . 
recording medium, the computer program comprising the prccessingsteps of : connecting a plvr?!!^!^^?^?™^., 
for displaying a three dimensions! virtual reality space'including an update; object cpnstrti^Y^ : 
objects each of which stated reject to charge to ^shared sewe?; terminal for ; control!!^ 

on each. of the plurality of dient :ermir,:ls yia L a communication n^twork;.re^^ringjn eaclrpf the, plurality afcl^nt ter- 
minals in advance a change, sequencers for,defining ; a relationship between^ ^sequence of chugging : the state of 
each of the plurality of sub objectraccording to a change to. the stateof the update object and a message for specifying v 
a type of the change sequence; when the state of the update object controlled byjhe shared server termjnalis updated, 
notifying, each, of, the plurality of client terminals of the message ; corresponding,to, updated content of the state of the 
update obiect from the shared server terminal; and changing on each of pe plurality of client terminals.the state of each, 
of the plurality of sut objects based on the change sequence specif ied by the message to reflect the change m thedis-, 
played three dimensipna! virtual reality; space; wherein, the computer program is. readable anrl, execrable by ; at leasj . 
one of the ^ tern'Jwalsxonsistinc of the,shared server terminal and the plurality of client terminals..; - rvi .^toYi-co:. ,^ [•::■ 

Jn carrying-cut the inverstion and according to a fifth aspect thereof, there is ; prpvided an information fr^msssipn 
medium for use in a thrrse-dimensicnal yirtua! reality space sharing system. to transmits computer program comprising 
the processing steps of: connecting a plurality of client terminals for displaying a three-dimensional virtual realty, space, r 
including an update object constituted^ a plurality .of - sub objects each of which state is, subject to change to^ shared, 
server terminal for controlling a state of the update object on each of the pluralrty of cHent.terminals via a communication, 
netv/ork; registering in each of the plurality of client terminals in advance a change.sequence ; table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub ; objects jaecordjngtOia change to foe. 
30 state of the update object and a message for specifying atype of ; the change sequence; when the state ofthe update , 
object controlled by the shared server terminal is updated, ( nptjfying each of the plurality of client terminals of the rpes,- 
sage corresponding to updated content of the state of the update object from the shared. server terminal; and.c^anging g; 
on each of theplurality of client terminals the state of each of the plurality : of sub objects based on the change.sequence. 
specified by the message to reflect the change in the di^layed^hre^ 
35 computer orogram is readable„and executable by at Ieast,ona pf ( the terminals consisting of the shared ; server terminal 
and the plurality of client terminals and the executab|.e ; comRuter program is transmitted.to at least qne r qf the terminals .- 
consisting of the shared server terminal and the plurality of client, terminals, t -jo-v-v: * r> : \ -co ^ : si * : ^\y;^ x :.• ;V* "■>■' 

In carrying out the invention and accordingjo, a sixth aspect.thereof, the*e is prcvid^an in^^ 
method for use in a three-dimensional virtual reality space sharing^system to transmit a computer program pomprising ^ 
40 the processing steps of: connecting a plurality of client terminals for displaying a threerdimensiona! virtual reality space 
including an update object constituted by a plurality of sub objects each ot : which_ state is subject to change toa shared , 
server terminal for controlling a stateof theupdate object on each of this plurality cf client terminals v;a a communication 
network; registering in each of the plurality of client terminals in : adyance a change sequence table for fining a/ela^ 
tionshio between a sequenced changing the state of each of the.^lurality.pf sub objects according to a changeto the 
stata of the update object-and a message for spec'rfyjng.a type of the changeisequence; when the state ofthe update;, 
object control!^ by the shared server terminal is updated, notifying^each ; oi the piu ality of client ^terminals of the rnes- > 
sage corresponding.to updated content of the state of , the update object from shared serverterminal; and changing, 
on each of the plurality of client terminals the state of each p? the pluralrty. of sub objects.based on the .change sequence ~ 
specified by the messaged reflect the change in the displayed three-dimensiqnal virtual reality space; therein the 
computer program is readable and executable by at least one of the terminals consisting of the shared server terrpjnalv 
and the plurality of client terminals and the executable computer program is transmitted to at least one of the.terminals 
consisting of the shared server terminal and the pluralrty of client terminals. , ; ^ - ; , , * . : . . 

In carrving out the invention and according to a seventh aspect thereof, there is provided an information processing 
method cf a client terminal in a three-dimensional virtual reality space sharing system in which a plurality of client ter : 
minals for ; displaying a three-dimensional virtual reality space including an update object constituted by a plurality of sub 
objects each of which state is subject to change are connected to a . shared server terminal for ccntrpl'jng a stated the 
update/object on each of the plurality of client terminals via a communication network, the information processing: 
method comprising the steps of: registering in: each of. the plurality of client terminals in advance a change sequence 
table for, defining a relationship between a sequence of changing.the state of each of the, plurality of sub pbjecte accord- 
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ing to 'a chlhtji'to thSsfatabfthS 6pdi%' object and a message tor specifying a type of 4he'ch^ng^^§quence; acquiring- • 
the rtiiss&ge coWe^bhaihgf the u^cfete donfent of tn&st&tedf the updafe object, the message tfeihy notified from the f 
shared sdrver terrHiriaf^rlfert^the state of thfe-UjxJ&tef object controll&Tfey the Shared S&rvef terrniri^iMS i^xlated; and- 
chariging the state'of' eABh of the plurality 6f sub objects basfed on thte' 6?»arige sequence specified* &y th& message to 

5 reflect the r chan^ - 0 ^ ^ - 1 

.in carrying qtf InVinV^ to an e!g'h^ : ^p^ therefef, there is provided a dient terminal in a three- * 

dimensional virtual reality? s^acS* kharihg system in which a plurality bf diient terrrMals for displaying' f i%ree-dim^rr\ 
sional virtual reality space including an update object constituted by a plurality of sub objects each of whidh £tate is sub- ' 
ject tt r chahge are ^ cohtrMn^a steY&>of the update object on* Sach of the 

10 plurality cif didht terming the client terminal comprising: a registering means for regis- : 

teririg fn each of the jpil uraftiy ? cSF Client terrhinals in advance d change W^u^rice t&ble for defining a relationship between 
a seqifence<)i chah^n^r^^ate earcH of the pffirality of sub 6bjecfe : acfe6rdff1g to aeh&nge tb the state of th^update 
object and a Wr^age'fer^i^ify^hg a type ctf the change s^qQ6ncei ^aii^adqtiHTng rrfearis for^cqairing the message cor- 
responding to the ( up^ the state of the update &bject, j1 the messia^e b&h$ nbtif i^-frbfri:th#shared 'server 

is terminaf when the st&e of theupdate objefct controlled by the shared' server terniiftar-is updat^;^rKTa changing means ' 
for changing the slate of each bf the plurality of sub Objects t>ased on the chSntje sequence specified by the message - 
to reflect the Ch&ngeln the' (^s^'^ed%)fee-dimensional virtuafreality spate?- : /^ ^^ l . - . - ^ u ■;, i« c-i 

In' carrying but the Invention* and accordinglcfa ninth aspect thereof, there Is provided artHnfbrrnat ion ■ recording 
medium for Use in'a'difenrt terminal in a threeMdimensional virtual reality space sharing systertvto record'a computer pro* 1 ' 

20 gram comprising the' processing steps bf: registering in each of the plifl-alrty of ciient teririinafe iri advance a change 
sequence tablerfor defining st relationship between a sequence of changing the state of each bf the plurality df sUb ■ 
objects according to a chanfge "to the state of the update object arid a message for ^specifying a type^ the change 
seq'uehtfe! Acquiring the message corresponding to th§ r up&ate'' content of the state of theOjpdate object, the message 
being notified from ftfre shared server terminal w>ieh the state of the update object- contrbl led byihe Shared server ter- 

25 minalls-dpd&t&^anaeha^ of eadh of the plurality of sub objects based oh the change sequence Specif ied 

by the messaSWtoi^fedt the change i the edmputer pro-; 

gram is recdrded inihe information rebordihg medium in a state readable arxj; executable b^the client terminal. " - • 

Wcsfrryirig out the invention and according to a tenth aspect thereof, ther'e" is provided afi information recording^ 
methocf of a 1 rec^rdihg'm^dium for use on a client terminal in a three-dimensional virtual reality space sharing'system 

30 to recbrd a computer program comprising ^ of: registering in each of the plurality'of Client terminals 

in advanCe a 1 change s^Ufence table-for defining -a relationship between a sequence of changing the state of each of 
theipluralit^ bf sub'&bjects according to a charige to the state of theupdate object and a message for specifying a type 
of the 6hangb%equence; acquiring tnernessage cbrresporiding'tb theupdate content of the' state i of the update object, 
the rrfes^ge'teiiig notrfl^dfrbrh the shared server terminal when the state of the update object controlled by the shared 

35 serverferrn'irial is-updated; iand changing the staite of fe&ch of the plurality of sub objects based on the Change sequence 
specified by the rhdssage to ref lebt the ; charlge 'in the displayed three-dimensional -virtual reality Space; whierein the 
computer program is recorded in the recording Wedturn in a &ate readable arid executable by the client terminal:- - 

' In b£'rry^ to an'elevehtfi Aspect thereof .there is provided an information transmis- 

sion medium for Ssd'bn a'client terminal iri a three<timensibrfal virtual reality Sp&ce sharing system in which a prurality 

40 of client terrhinals fbr displaying &4htf ee^imehsibrial- Vlrtuarrfedlity space including an update object constituted by \ a 
plurality of sub obj^Seach of which state Ss subject tb change affe connected to arshared server terminal for controlling ' 
a siate of the update Object Ori each of the plurality ^6f c client terminals via a communication.neitwofk, the information 
transmission method 1 ^nsmlttirig a computer prbgrarri cornprising the r prbcessing steps Of : registering in each of the^ 
pluh^lrty of xlreh! feFrhinais in advance a change? Sequence ^ stable for defining>a : relationship between a' sequence of 

45 changing the slate of each of the plurality : * of "sub 'objects according to a change to the state of the update object and a 
mess&ge' ^for specifying a type of the change «iequehee; acquiring the message correspondirfg to' the update content of 
the^-state of the update object/ the message -being hotified^m the shared server terminal when the state of the update 
object controlled by the shared server terminaf is updated; arid changing the stateof each of the plurality of sub objects 
ba6ed dh the change sequence specif ied by thei'rrfessage to reflect the change in the displayied three<iimehsiohal vir- 

so tual reality space; wherein the computer program is transmitted to the client terminal in a state receivable and executa- 
ble by the same. '"■ • --• ■ ■ , '-i V"--"' - • • f ' -'• V- " ' -' 

In carrying out the invention and according to a twelfth i aspect thereof , there is provided an information transmission 
mefthbd for use on a client terminal in a three^irnehsibhal v which a plurality of cli- 

ent terminals for displaying a three-dimensional virtual reality space including-attupdate object constrtut€id by apkirality 

55 of sub objects each of whiGh state is subject to change are Connected to a shared server terminal for cohtrollinig a state 
of the update object bh each of the plurality of client terminals via a 'Communication network; the information transmisr 
sioh method tran^rtiitting a computer program comprising the processing steps of: registeringiinieach of the*plurality of- 
client terrhinals'ih advance a change sequence table for defining* a relationship between a sequence of changing the 
stafe'bf each of the plurality of sub bbjecits accordThg to a change tb the state of the update object and a message for 
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specifvinaatype of. the :Change/oequencs; squiring ,the : -message corresporuflng£:;^ 

the uodate object, the message b*ino v notif ied,from the sharec^serve^ th; statapf the-upd~t( .object ccn- : t 

trolled by the ?hcred •server-terminal is i\ 6a*ed; and changing the state c^each.pf $3 o!yra!fe; sub pbjecte : based ; on. ^ 
the chango^aqueRco soadfied by the massac* eflect the change in the displayed- thre^ 

space?Ayherein the computer program te : tra^ii!,^d,tp the dient ^rmtna! in a,statG ; recede ^rid^executabje by the v ; 
same, v ^ v. r. - . ' v.;-' r. ; ;;r'^ ^^Vf':M.i-::i:, : ■>:>' -o ,v;;.^ ^v-'V.r ..*>v 

Inxarrying out thair.vention and acoordir.g to:a lhi,^nth aspect thereof there is ftrovicled ^i:,iormation process-r 
ing method oteshared server terminal in a three-;! : ms.i^onaf vir^a! reali^.space sharir.g,systerr in which a p.urahty : . 
of client terminals for displaying a three-dimensional virtual reality space including an updaie object ^nstituted by.a : ' 
plurality of sub obieCs each of which .state is subject to change are connected to a ^ 
a state cfrthe Mpdate'objeeton ee.ch.o1 the.plurafity c* dient teririinals^ 

processing method comprising the c4e?s c,: ^termining update pf ,the tho.-. 
shared, server terminal; and, when the static? thereto object is updateci, nop yjng each, c; the plurality of cherrt ter- 
minals of a message for specifying a type of a change sequence of each of the plurality of ^ objects corresponding f 
to updated content of the* state of the, update pbject from the shared server terminal;- - : s * on v: : - l 

In carrying outthe invention and according to a fourteenth aspect thereof Jherejs provided a shared ; servet;terrni-; r , 
nal in a three-dimensional virtual reality space sharing system in which a plurality : pf client terminals for displaying a 
three-dimensional virtuaUeality opaco including an update pbject constituted by a plurality, of sub pbj^cts each of which, 
state is subject to change are connected to a shared server terminal for controlling a state of the update objection each 
of the plurality of client .terminalsvia a communication network, the shared . server terminal comprising: ,a determining 
means for determining update of the state of fte, update object cpnirolleciby the shared seive^errnina!; ancV when the. t 
state of the update; object is updated, a notifying means for notifying, each of the pluraUty pf client teriTiinals of : a;me%: 
sage for spepr^ing a type of. a change sequence of each of . the plurality of sub objects corre^nding^oyr^at^ cpn-v. 
tent of the stste of the update object from the shared server terminal; ^ <• ;.->••• ■■■ • •• r- , . v. - so*:- . 

In carrying out the invention and according to e fifteen aspect thereof, there is r 
mediurryfor use- on a shared server terminal in; a three-dimensional virtual reality space sharing system in which a plu- 
rality of client terminals for displaying a three-dimensional virtual reality space including an update, object constituted by 
a plurality of sub objects each of which state is subject to change are connected to a shared server terminal for control- 
ling a state of the update object on each of the plurality of client terminals via a communication network, the information 
recording medium recording a computer program comprising the processing steps of: ^determining update of the =statp * 
of the update object controlled by the shared server terminal; and when the state of the update object is updated, noti- 
fying each of the plurality of client terminals o* & message for specifying a type of a change ^sequence of eacb c*the 
plurality of sub objects corresponding to updated content of the state of the update pbject from the shared server ter- 
minal; wherein the computer programjs stored in the information recording medium irva state readable and ^ecutabie 
by the shared server terminal • .<:.. ■ 1 - ~ = ^na: Y> sic/* -y : h: r. .. v , r rr~:*? .■ .^j- 

In carrying out the invention and according to a sixteenth aspect thereof, ^ thsre is provide ^n^nforrnctipn looming 
method for use on a shared serve; termina! ,:n a three-dimensipncl .> irtue! reality space ^having system in wh>ch a plu- 
rality of client terminals for displaying a three-dimensional virtual reality space including qn update object constituted by 
a plurality of sub objects each of which state is subject to chang? are connected to a shqred server terminal ; fcr ; control- 
ling a state of the update object on each of the plurality o: clientite^minals via a communication netwoi . the information 
recording method recording a computer program, comprising otthe processing steps of: determin:ng i ypc!ate,of the state 
of the update object controlled by the shared sen/er terminal: and w^en the state pf-the update object is updated, noti- 
fying each of the plurality of client terminals of a message fer specifying a. type of a.change sequence 5 of each ofthe 
plurality of sub objects corresponding to updated:content of the state of the update object, from the shared sender te-- 
minal; wherein the computer program is stored in an information recording medium in a sta*3 readable and executable 
by the shared server terminal. * ^; ; ; : , ^ v 

In carrying out the invention and according to a seventeenth aspect thereof, there is provided an;information trans- 
mission medium for use on a shared server terminal in a 5;hr^e-dimensional virtual reality space sharing system in which 
a plurality of client terminals for displaying a three -dimensional virtua', reality space including an update object consti- 
tuted by a plurality of sub objects each of which state is. subject to change are connected to a shared server terminal 
for controlling a state of the update object on each of the plurality of client terminals via a communication network the 
information transmission medium transmitting a computerrprogram comprising the processing steps of: determining 
update cf. the state cf £he update object controlled, by the shared: server terminal; and when the st^te of the update 
object is updated, notifying each of the plurality of client terminals of a message for specifying^ type of a change 
sequence of each of the plurality of sub objects corresponding to updated content of the state of the update object from 
the shared server terminal; wherein the computer program is transmrrted to the shared server terminal in a stcte receiv- 
able and executable by the same. : • o v- ? .•- "j - i' i .' - - : • " ■ - : 1 

In carrying out the invention and according to an eighteenth aspect thereof, there^is provided an informatic n trans- 
mission method for use on a sha. ec r server termina 1 in a three dimensiona! virtual realit>;space sharing system in which 
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a plurality of client t^rmih^ ; fcr'cli8^9^ n g T : a thf^e-dimehsiorral Virtual reality ^3ce' including anuptfate object con^tP 
tuted'by a plurc$tj^ , s&6'-6bjb^ to change ate connected toia shared feervef {terminal 

for controlling a c state of tfte ^p^dat^ o&f edt oh ea$ft of the plurality of client teFrfnhS^via acomniunicatiort^fetwGrk; tie 
intonation tranreml&siori ' htethfod tr^nsifihting^a computer program- co>Tt|bfi6ing fhe processing Steps of r detertrtining 

5 update of the stale oftfi§ Update objfectcdhtrofted by the "shared ser$8r f&rtrtiriat; &rid when trte state'of the update 
object is updated, notifying each ol the plurality of client terminals of a message for specifying a type of a change 
sequence of each ofitftfcpturiality'Of sub objects correspondinglo i^atedrcontentofihe state of the update objectfrom 
the shared server terminal; wherein the computer projgrahi id£fansmrtted to the shared: server terminal in a state receiv- 
ableiand Executable by thes&me:. .v ■'■J/^vr !mt. ■ no^,:* ,) ; rarrr 

10 AcfcSHding to ttte present inv£fo1idh;in t tfi^^^ the sysferri, the informa- 

tion* r^Vding TT^ium,^tte~ii^^ infomi^ifrri'transthiss^ 

transfhi&siofV metHdd, Hh^^h&Vg^e^ufenc^ of th§ plurality >of sub bbj&Ofs dbrifespericfi rig to^e^updated content of the 
state of the r updat^ 6bje€f inbred hi ^oftclienrl: terminal arid the changes sequences oh theplurality of client terminals 
arestart^myrichrohlzdtioh; ^ — •- ' * ^ ^ i ? to tfqvf e tPT^ ^ - r -' * ; " 

15 Further, according to the present invention, 1 in the information' processing melfaxf? the client -terminal, the informa- 
tion recording mediurh, the information recording methbd, the information trahsrrrfseiori^medium, and the ; information 
transmission method! the change 1 sequence of the plurality of sub objects corresponding to the ; update content of the 
state of ^e update objefct is stored in a client termi'rt^l arid "started in synchronization with the change sequences stored 
in other-client terminals. ^ )l " '• '-'^ • — : * ^ " <; a ■.. r .r. f. :r- ■ " j : ■ -. 

20 iFurther7 according to the present Invention; in* the information processing method, the Reiver ferminal/the ihforma*- : 
tion-rfecordirig rhedium, the information recording method, the information transmission medium and the information^ 
tran^issfoh nVethbd, ; if a rhessage indicating updafe of the state bf the update object is entered 1 from ^specific client • 
terminal vfe theglbbal communication network, this Message is transmitted to other client terminals' via the glbbal com- 
munication network and, in synchronization with the change sequenced the plurality of sub objects ih thie specif ic client 

25 termihali'the change sequences of thte plurality of sub 'objects in the other client terminals? are started* l - ». i v hV ? r 

The above and 6ther 6bjects, features and advantaged of the present invention'wil! become more apparent front y 
the accompanying drawings; in whiGh like reference numerals are used to identify the same or similar parts in 'several 
views.* -'"'O--. ° ; ^ " ' • : ' ^ ■ ; : - / v.: 

30 BRIEF DESCRIPTION OF THE DRAWINGS !? : v ■ w : - v. --v *. " -q i© V.v^v* . - ; • ^ 

*FlGs 1 is si bloSR cliagramMllustrating an example: of the cbnstitution of a cyberspace system practiced as one pre- 
ferred effibodimertt of the present invention; - - : ^ v -" s ' ' '< *= ; "? ' f " >-> 1 ^ - . - • - ^ 

^G)-2 is a b1ck;kdiagram iliustratiri^ n - * 

35 FIG. 3 is a block diagram illustrating an example of the constitution of a client terminal 13 of FIG. Xy > - ; ' - '< ^ 
FIG. 4 is a bibck diagram *llusfratihg:ah example of the constitution 'of a service provider terminal 14 of FIG. T; 
FK3: 5 is* a" di^gr'am describing a virtuaS reaiity'spacW formed by the cyberspace system of Fig T;" '■■ * : = ; ; 1 

\'FIG:.6 : is-a ! ciiaigfarh'desGribihg a View'fieid'Seeri^rbm'aVdteir G;- v '- •• ; ,fl '' - -^v c- : . -v-'-A ,>\; 

FIG-yisa^diagram describing 4viev/ field s'een-frbiTiavatai'D; .*>; ; '.'-^^ : ^:^r:;> vj orr, . ;^ ^r;-;^ 1 
40 FIG; 8 is : a diagram desc^ " J ; * - > .i.j i 

'FiG.^'A 1 is"a diagr^desaibing'»di^play«^at1^Me of a message' list;' ; { : r : * ^r',r» / f < v. -.*.-,v, 
FIG. 9 B is a* diagram describing a display r example of the rftessage list;i ; • . ■ -v r-'- ^ ,v :i v ~v ( :i . : 
FIG;-10 is-a diagram iflustrating a display • - : * ; v ' ... 1 ; - / »c ft :. -i r.- : 

RIG.^ 1 1 is a diagram illustrating a display example of a cl ient terminal 1 3-2 ; c 1 o r - • ' -- v " *- ' ; ■ 1 * *- , : ;1 * 
45 F!G. 12is a diagram illustrating a display example of a client terminal 13-3; j ' v !s 4 ,;^. ?■ , : r : * .. . 

FIG. 13 is a flowchart describing the processing of message 1 ; * :r ? / ; ~ '^r ' 1 ^ -■: 

FIG:* t4 is a diagram illustrating avatar ; movementin c the virtual reality space; >- : . ; -is - ~ ru, = 
FIG. 151i5 a flowchart describing the processing of message 3; ■ ; :,.r:.v: ' - j ; rf.ii .i »-:■.*.. : , 

• FIG: 16is a flowchart describing details of the processing of arm movement in step iS24= of FIG:' 15; - *- - > r : ; 
so '^FIG: 17 is ai flowchart describing details of the processing of leg movement in step S25 o? FIG.-15i N > i ^ 

^FIG.- 1 8 is a diagram illustrating another display example on a client terminal ; r. ' ■ ■ ? \' \ ■> . . & :. m i , - \ ; : 

^FIG: 19 is a flowchart describing the-processing in which complex movement is startedr;V( r. ; " • r 

^FIG;20 is a btock diagram illustrating an example of the constitution of the cyberspace system practiced asr another 
preferred ^embodiment of the present- ^invention; - . :* *■< ; ^ ^ - :^ b : * * -r^ 

55 : FIG/21 is a diagram describing the WWW (World WideWeb); : ->\ r ^ ; x ^ ; ^ ^ 

- •FlG?-22«is a diagram il!ustrating*an example of URL; ^ 1 vh: •:<,» , ■ : * , ^ - \ => ^ a: - : . 
FIG. 23 is a block diagram illustrating an example of the constitution of a mapping server terminal ; ■ - • "> : 
FIG.^24 ! is aflowchart describing thei operations of the client terminal 1 3 (the service provider terminal 14); i: 

^FiG: 251s a flowctiart ^describing the operations of an information server terminal tt A; k : ■ l 9 - . .■ 'c ?i ^r.^ / : 
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F-IG. 26 isa^owohartdescribing the operations of a -mapping server terminally ^ /. :,;:< ^ ; vr^rv;..;^ 
FIG 27 is a flowchart describing the operations of a shared server terminaMIB; u.'v > ?• ».^*^ 

.F!G :o 28::is. a .btec^iagram :illt*t;aing the client terminal, 12 practiced as another preterrer! embod:m^t o. ^ie 
orecent invention; • ■ . 'c \ .v ;■ \\ :. x - • n- - "■-.c--. ^ *.<•.* ^jc\ .: , ■ 

FIG! 29 is a diagram describing locations in which basic objects and update objects arc stored;^ , , - ,* v..:. 
FK3. 30 is a diagram describing the arrangement qf basic objects and updateobrects; - - 
FIG 31 is a diagram describing software for implementing the cyberspace system; ■ ^ ■ 

F3<3,32,is a-diagram describing software operating on the plietf.termina! 13:1 and the.shar-d;sep:er terminal 11B- 

FIG 33 is-a diagram d'3scribinQ.;ttie v3nviroomiertJrji:Which--the .software •operates;.;' - j?j.;*v * <. t -.w-tf" -* ! 

fig! 34 is a digram i'lustrating a display example cn the shared server ternina! 3 of F!G, 32; V; ' ,/ ; 

FIG ,35 is a diagram illustratirg ; anotr.er display, example on the shared server te^iinal M B^ct^lQ^;^' , o . ■ 

FIG 36 is a diagram illi 'Sti atiiTg stili another display example on the shared rerver,termiria3 ^43-1 of F.G 3*..- 

FIG. 37 is a diagram ill ustrstinc yet anther display example on the sharedseryer terminal 1 3-1 ;Of FIG- 32; ; 

FIG. 38 is a diagram iJiystratiog a display, example on the client- terminal 13-1 of F!G. 32; * : ? y , r 

FIG. 39 is a diagram illustrating a display example on the shared server termina.M1B-1.of FIG 32;: r o 

iFIG. 40 is a diagram illustrating e .dispJay.exampI.e on the client terminal 13-1 of FIG: 32; -r-.-v - {: ^, :n 

FIG 4t is adfacramlllLtstraiina another display example on the shared server terfninaldl cf FIG. 32; -: 

FIG. 42 is.block diag. illustrating an example of the constitution of a cyberspace system .build via the related art.- 

LAN- ir;k ..•> -k r, ■• ■ " " - - 4 ! : 

fig 43 A is a tfaaram illustrating a display, example in the cyberspace system buift via the related art LA IV; , 

FIG 43 B is a diagram illustrate another display example^ >h5 ; cyb^rspace rystem built vis th3M.md«crt LAN; 

FIG. 4?^Q ; is,?, djagram illustrating stilt another display example in the cyberspace system bu It via :hr>Tfelateii art ^ 

f^'jj is diagram illustrating principles of operations of expressing related art avatar walking. bfthavici - , n ^ 
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS. / , ^ ^ - ■■"< ; ■ ^ ; 

This invention will be described in further detail by way of example with reference to the accompanying drawings. 
The basic idea and concept of a virtual society Js described byHiroaWK^ 
ries,: , as follows in; hischome , page "Kitano Virtual Society: (VI. OMhttp://^ 

^In the beginning o«he 21st century, a virtual society would emerge in a network spanning al! the world.: People in-, 
every part of the world will make a society in which millions on hundred millions of people Sve in a.sha. od s^ ace created . 
in the network. A society that will emerge beyond the current Internet CATV; and the.so called infw^tio.T super hjgh-, 
way is a virtual society that I conceive.' In the . virtual society; people camnot only pariorrr. general:-/ the same soc:t;. activ- 
ities as those in the real world-enjoy shopping, have a chat ; play.games. do work., and the !.k< -r.uv. also perfo, m tunySi- 
that are possible only in the virtual society (for example. -wowing franrTokyorto Pans in an instant) fcu&i a -^ociety^, 
would be implemented onlyby saate-of-the-art technologies such as cyberspace constructing technologies thai support 
a broadband network, high-quality, three^dimerisional preseniatior.-.capi*ility:and bidirectional communications; o?voice ; 
music and moving picture signals^ and a large-scale. distributed -jystetn that.allow-s. a lest of people torshare the con- • 

Si details, look at the above mention home page (UBL.= http-7/www.csl.sbnyxo:jp/persor^^ 

^Selhree-dimensional virtual reality 'space that implements the above-mentioned virtual society. is a'cyberspace 
system. The actual examples of the infrastructures for- const ucting .this. cyberspace system iriduJes.,at^panl-of, 
time the Internet., which, is a. ^world-wide computer network cohnected by a communications protocol called TCP/IP 
(Transmission Control Protocol/Internet Protocol) and the intranet ^implemented by. applying the iirternet technologies 
such as the WVVW (World Wide Web) to the in-house .LAN (Lecal Area Network). , Further, use of a broadbarrf conjnu- 
nication network based on FTTH (Fiber To The Home) in the future is proposed in which the mairi.l.ne system and the 
subscriber, system are all constituted by fiber. optics: > ; . .- . , ^ ' ' ' ' . "" * " I".' .r- ' 

Meanwhile. - for a( v information providing system available on the Internet, the. WWW -developed, by CERN (EurcK 
pean Center for- Nuclear Research) in Switzerland is known: This technology allows a user to browse information includ- 
ing text image and voice for example in the- hyper text form. Based on HTTP (Hyper Text Transfer Protocol).-the 
information stored in a WWW. server terminal is' sent asynchronously to terminals such as persona! computers. - • 

The WWW server is constituted by server software called an HTTP demon and an HTML file in which hyper text 
information is.stored.' The hyper text. information is described in a description language called HTML (Hyper Text 
Makeup Language), In the description of a hyper text by. HTML, a logical structure of a document is expressed in_a for- 
matsp3cification.called.a-.tag-.erK*»^ m,,nk 
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information called an anchor. A method in which a location at which required information is stored by the anchor is URL 
(Uniform Resource Locator). >; \r -c^-v. :;L • k : )\-rK z ;\ vs 

: A protocol for tranisferring a file described 1 rh HTML on the TCP/IP network HTTP. Tnis protocol has a cajDabHity 
of transferring a request for information from a client to the WWW server and the requested hypertext informitiora 
5 stored in the HTML file^b the olieni.:; - : - V .-D.^d'oirw : : -nr. ; 

Used by many as an erivirohmeiit for using the WWW-is CliehV software such as Netscape Navigator (trademaVK) 
called a WWW browser. ■■■:.>* • . ~:w.v\y - ;-v ^ 

4* should be noted ShattJernoh dendtesa program for Executing control and processing in the background when per- 
forming a job in the UN IX environment. 
10 Recently, a language for describing ihree-dimensional^graphics data; called VRML (VirtusU^eality -Modeling lan- 
guage) and a VRMLViewei fCr drawing a virtual reality space describee inthis VRML on a personal computer or a work- 
station have -been- developed J VRWILi allows to 'extend -'the WWW ; : sea ! hypertext linksMo Objects rdrawn by 'three- 
dimensional graphics, and fdnowifHese links; to "sequentially access WWW server terminals. The sp&df ications of VRML 
version 1 ,0 were madeplibfic irt'Mafy 26, 1 995. Theri,inNoveltiber 9i t995; a revised versibnln which errdrsand ambig- 
75 uous expressions are corrected - was made 'public.; ■ The specif icatidns' = are^ available from URL = 
http7A/vww.oki.com./vTrri^^ t * v, t : t v O;' i*** * :*y?*q*-'*r. ^ . 

Storing three-dimensional information described iri the above-mentioned VRML in a WWW server* terminal allows 
the construction of a virtual space expressed in three-dimensionaf:graphics : on the Internet. ^ Further, use* of the VRML 
viewer by musing personal computers arid the Hke interconnected by the 'Internet can implernerit the display of k virtual 
20 space based on three-dimensional graphics and the walk-through capability. - - • 

In whatfollows,- examples in which the Internet is used ior a network will be 'described. It win* be Apparent to those 
skilled^iri ths ail that FTTH hriay be used instead of the Internet to implement thevirtual space. ''■ '/ ^' ■ ? - ' ^ '^ ^ 

« It should be noted<that Cyberspace* js a coinage by William Gibson, a OS science fiction writer,' and' was used in his 
"Neuromancer" (1984) that made him famous. Strictly speaking, however, the word Cyberspace first appealed in his 
25 "Burning Chromfc" (1 982). In* these novels, there are scenes'in which the hero attaches a special electrbde on his fore- 
head to connect himself to a computer to directly reflect on his brain a virtual three-dimensional space obtained by vis- 
ually reconfiguring data on a computer network spanning ail over the world: This virtual three<limensi6nal spade was 
called Cyberspace. Recently, the term has come to be used as denoting a system in which a virtual three-dimensional 
space is used by a plurality of users via a network. *.» - . * ' i m h ' o : ! ■ \ ? *o ,. 

30 Now/ referring to~ FIG. 1 , there is'shown an example of the constitution of a cyberspace system practiced as one 
preferred: embodiment of the present invention. As shown, a given number (in this case; two) of server terminals 11-1" 
and 11-2 have storage devices 30-1 and 30-2 respectively and are adapted to provide a virtual reality space via a net- 
work 15 (aglobal communication network) represented' by Wie Internet for. example. In additiori. a given number (in this 
case; three) of client terminals^ 3-d through:l3-3are installed to redfeive the virtual: reality space and specific Services 
35 (infoonation).usirig' the's^&rfrom the^server t(Girrhmalsrri>:t and- 1 1:-2via the- network 15. n. ? - ^ '\ , v : ' 

Further, in the above-mentioned ? erhbodim ar it ; a r given -number-- (in this case, two) of service 'provider terminals 14- 
1 and f 1 4>2 are instailedto receives the virtuaKreality:spapetirom the server terminals ^1 1>|1:.antf 11 -2>via the network '15 
and provide specific services to the client terminals r 13-i through > .>r\ ' :- ;„ < r v- ' ; - - v f ■ 

iE\G^2 shows an example of the ^constitution* of;, the sierar terminal 11 (namely* -11 -T and 11-2): As* shown? the 
40 server; terminal.1 1:*ias a CPU 21: The CPU 21 executes a* variety processing operations as ^instructed by a 'program i 
stored in-a ROM 22. A RAM 23; appropriately. stdre&data and.aprbgram necessary for the CPU 21 to execute the varii- 
ety of processing operations. A communication device 24 transfers specific data with the network 15 (the Internet)! - - v 
A display device 25 has a ^ CRT (Cathode Ray Tube) or;an LCD (Liquid Crystal* Display) for example and: is con- 
nected to interface 28 to monitor images of the virtual reality space provided by the server terminal 1 1 . The interface 28 ' 
45 is also connected with a. microphone 26 and a speaker £7 to supply-a specific voice signal to the client terminal -13 and 
theteervice prbviderierminal 1 4 and monitor a yoicd sighaf cbming *frbm these terminals: : r : ' : - - " : " ' 

The^erver -terminal 11 has an input device 29 on which a variety of input operations iare-perforrhed via the interfaces 
28.,This input.device+ia6at letast a keyboard 29a arrd a/tnouse 29b. v i "' - ^y. c^. . ■ 

FIG. 3 shows an example of the constitution of the clientt^rminal l 3 (namely; 13^1 through 1'3-3): The fcNent tfermi- : 
so nal 13 has a CPU 41 which executes a variety of proeessihgi operations according to a program stored in a ROM 42. A . 
RAM 43 appropriately stores data and a program necessary for the CPU 41, to executes thfe variety of processing operr 
ations: A/communication device 44 transfers data to the server terminal 1 1 via the network 1 5>(the Internet}."'; 

-{A display device 45 tias a CRT or an LCD to display threei-dimensional images created by computer graphics (CG)- 
or taken by an Ordinary; video camera. A microphone 46 is fused to output a voice signal to the shared server terminal 
55 1 1 . A speaker 47,outputs the voice signal coming from the. server terminalrtl ..An input device 49 is operafted:to perform 
a variety of input operations., ; r . , ^ / n' ::tr : - ^ ; c . ; r ; - • ;:^'' n * v " 

A keyboard 49a of the :rnput device 49 is operated when.ehteririg specific characters and symbols. A mouse 49b is 
operated, when, entering specific positional information. A viewpoint input deyice 49c is operated when changing:the^' 
state.oHhe.avatar (object), as anujxJate object of the client terminal 13. That is, the viewpoint inputdevice 49e^$*used ^ 
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to enter the viewpoint of the avatarof the client terminal .13, thereby, moving the viewpoint c^tae^avatar vertically,, horir 
zontally or in th^ depth direction and zooming a specif ic imaqe. In, addition, the .movement input device 4f3d]s used to 
move t^e avatar in the Jowar^ 

It is apparent that the operations dpne.athrough the viewpoint and movement input devices may also be done 
s through the above-mentioned keyboard 49a and thejTTouse 49b. ^> - : 

Interface 48 constitutes thedsta interface with a display device 45, a microphone 46, a speaker 47* andean input 
device 49. A storage. device 50 composed of a hard disc, an optical disc, and ; magn$to-opttcal disc stores data and pro- 
grams..:- < - ^ ;. .;; ... ^ , ( _ ■ } / " " • , , 1 ^ , . ^ , ' . / 

FIG. 4 shows an example of the constitution of the service prcwijdertQrmin&M 14-2)r,The'com- 

10 ponents including a CPU 5,1 through a storage device 60 are generally, the same as the components including the CPU 
41 through the storage device 50,gf ;FIG. J5 and therefore the description of the CPU 51 tftrough jhe storagedevice 60. 
is omitted. *i ; r- ^ - . - '-• o-rjsi&^t^^ /-.< * \iv*-\<-^-^k- r } \ *-i 

FIG. ,5 schematically shows the three-dimensional yirtual-realitysspace (hereinafter. appropriately referred to pimply 
as the virtual reality space) prov'dedby the server, -terminal: 1 1 of FIG. 1. As: shown, this virtual reality space constitutes 

15 a town, in which avatar (update object) C (the avatar object of the client terminal 13-1 for : -example) and avatar (update, 
object) D (the avatar object of the client terminal 13-2 for example) move around. v , , ; ; , >f r . 

Avatar G sees an imago as shown in FIG. S for example from the posjtiqn and viewpoint in the virtual reality space, r 
Namely, an image as shown in FiG.,6 is provided to the display device 25 'Ofiithe^cliont terminal 13-i- from the server 
terminal 1 1 to be displayed- Then, when the viewpoint and position of avatar Care changed (updated) by operating a 

20 viewpoint input device 49c and a movement input device 49d(or the keyboard :49a and the mouse >49b), the three- 
dimensional image forming the virtual reality: spac<e supplied from the server terminal ,1 1 is changed accordingly. 

Likewise, an image as shown in FIG. 7 is displayed on the display device 45 of the client- terminaM 3-2 to vvhich 
avatar D corresponds; This displayed image is also changed by moving the viewpoint and position of avatar, D.-;, r 
It should be noted that, in FIG:, 5, avatar C is looking in the direction of avatar D. so that avatar D is displayed in^the 

25 image (the virtual reality, space) on the display, device * f ; i; 

Likewise, in FIG. 5, avatar D is looking in the direction of avatar C so that avatar C is displayed in the image (the 
virtual reality space) on the display device 45 of the client terminal 13-2 as S;hqwn in FIG. 11.;- 

In what follows, operations necessary for moving (updating) a specific object (an update object of which stateis 
subjecrt to.change) will be described. For simplicity,, it is assumed, as shown in FIG. 8, that images of the virtual reality 

30 space seen from the viewpoints of the avatars of the client terminals; 13-1 through 13-3 are displayed on the same 
respectively- ln ; this example,- a conical object 101, a quadrangular prism object 102, and a cylindrical object ! 03 (an 
update object) are displayed. It is also assumed that the client terminal 13-1 pperates the conical object 101, the client 
terminal 13-2 operates the quadrangular prism object 102, and the;client terminal 13-3 operates the cylindrical object 
103 by meane of the movement input device 49d (or the mouse 4^) to move the objects— ; ^ j :/ - % 

35 In the above-mentioned case, in the client terminals , 13-1 through 13-3, a message, table (namely, a change 
sequence tab!e) as shown in FIG. 9 A is stored in the ROM 42 or the RAM 43. dn theembodiment of FIG. 9 A, a move- < 
ment message is registered as message number J. This movement message specEfies an object !D for identifying an 
object to be moved, a direction of the movement of the object; a velocity at which the. object :s moved,:and a period in 
which -the object is kept moved as specif ication items (parameters): $, s -», ( y. \._ : -.. - . j ;. = :\v ; < ; : i' 

40 A stopmessage numbered.2 is for stopping a moving object, specifying an object ID for identifying an object to be * 
stopped..- . * .? — - ; w ■ ^ ... ... i0 ^ , + . 7 ^ ; . : K , ±. r , • ;; r^^-t 

An avatar movement message numbered 3 is for moving an avatar, specifying an object ID for identifying an aveier v 
to be moved, a direction of the movement of the avatar, and distance of the movement of the avatar. One avatar object 
is composed a total of five sub objects; a body including a head, a; right,arm,,a left arm, nght leg, and left leg. To change 

45 the positions, of the arm and leg sub objects.of an avatar as the same moves-about (namely, .to move the avatar^while 
making theright and left arms swing and the right and left Jegs aiternate), the number of fluctuations (around the joint;, 
with the body} of the arms and legs per unit timeis: also specified as a parameter. r > : . : 

A complex operation start message numbered 4 specifies an object ID for identifying an object that performs a 
complex operation. A complex operation stop message numbered 5 specifies an object ID for identifying an object of 

so which complex operation is stopped., , : - ... ; ; : . 

A message numbered 6 specifies a parade start This parade start message is implemented in a three<limensronal 
virtual space of CIRCUS PARICto.be described later. For example, this message starts a parade in which clowns, sea 
dogs, a bear.riding on bicycle and the like go.in a procession as shown in FIG. 9 B. In this case, the object of the entire 
parade is composed of sub objects such as the downs, sea dogs, the bear riding on bicycle and the like^ And the sub 

55 object of a clown for.example is further composed of a total of five sub objects; a body including; a head, a right arm, a ', 
left arm, a right leg, and.a left leg. To make this clown walk as it proceeds while swinging its-arms and legs forward and 
back, in addition to at least a direction in which the entire clown moves, a velocity at which the entire clown moves, and : 
a period in which the entire clown continues moving, update information is required including the number of fluctuations 
per unit time of the sub objects of right arm, left arm, right leg, and left leg around the joint to the body. In this.case, the 
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fluctuation; an^^ ; , 

Therefore, -in addffibh to a direction in Which the entire parade processes, a velocity at which the en'tireparacfe prod- 
esses, and the period in wfiich the ^ntite parade continues processi nig; We message numbered 6 specifies 1 a h^adiifigr 
sub object ID1, aclown for example; a sSdond sub object ID2, a sea d6g; a last sub object FDn ( the bear riding oh bfcy* ! 

5 cle, the number of fluctuation times per unit time around the above-mentioned joint of hand sub objects (rijght and I6ft) - 
of each larger sub Object 1 , arid the number of fluctuation times per-unit time around the ateovementioned joint of leg sub 
objects (right and 16ft) 65 §ach 'large? sutfobjectVrn this cas£, it wiH be appiarent that tfte different numbers of fluctuation 
times may be set to the hand and leg sub objects of different larger sub objects of clowns, sea dogs, and the bear, 
thereby expressing cbmpfex proceedfng befhavtors as'the parade in its entirety. - >■ " - > 

w For k sirriple example, it is fc^umed^hatVlnlhfe client terminal 13-1 ; -the conical object 101 (an'update object) is 
moved from the^posftioh bfddtted ; liffe to theposition of solid lina WheriXhe movement ! ihput device 49dor the mouse 
49b of the client terminal 13-1 is operated to instruct the CPU 41 to move the conical object, the CPU 41 generates the 
movement message of 'nurrtber 1; Namely, the object-ID of the conical object 101 Is iiet as the ID of the object to be 
moved. In addition, specific values are set for "the direction, velocity, and period of movement according to the inputs 

is (the operatiori : 6f the input devices), 1 • { ' ^ '■'■*^') " • ■ ' ; 

For example, as will be described, if the 1 setting is madesuch that, when the mouse 49b is moved up with the left 
button kept pressed, the object rhovei forward at a velocity corresponding td the distance of .the movement of the 
mouse 49b. the ? dfrectiori (in this case! ujSrward),- the velocity (in this case, the distance bf the movement of the mouse 
49b), and the period (in which the mouse has been operated) are detected by the CPU 41 to be set in memory. : 

20 Then, the CPU 41 executes the message that was created by itself*' Namely, image data are generated such that 
the conical object 101 moves to the position from the position of dotted line to the position of solid line as shownin FIG. 
10, which is outputted to the display device 45 to be displayed. ' ' . 

Further, the- GPU' 4T< of the client ferrhinal 13-1. controls the communication devicfe 44 to transmit the generated 1 
movemefifmessageto the server terminal li-V via the network 15. Receiving the movement message via the 60mrhu : 

25 nication device 24, the CPU 2 1 of ■the server terminal 11-1 outputs the- received movement message to the client terirtf- v 
nals 13-2 and 13 : 3 from the communication device 24 simultaneously. * < ~ ; > 

Receiving the movement message via th£ communication device 44, the CPU 41 of the client terminal 13-2 exe- 
cutes the processing specified in the received movement message. To be more specif ic, from this movement message,' 
the CPU 41 identifies the conical object 10T as the object to be moved, reads, from this movement messagerthe move-* 

30 ment direction, velocity; and period in the virtual reality space, generates data of an image for moving the conical objiect' 
101 in the virtual reality space, ahd'displays the generated image data on he display device 45: The similar processing 
is performed on the dient terminal i3-Z.. Consequently, the conical object 101 appears moving on the display devices" 
45 of the client terminals 13*2 and 13-3 in syhc^rohisatfon as showh in FIGS: 11 and 12. ; ' 

Namely, in the above-mentioned case, the image for moving the conical object 101 is locally generated on each of 

35 the client terminals' 13-1 through 1 3-3 to be displayed, rather "than that the server 1 1 -1 generates the Image for moving 
the cortical -object iOi to supply the same to the client terminals 13-i through 13-3. Cbnsequently, the volume of com- 
munication between the client terminals 13*1 through 13-3 and the server terminal 11-t can be' minimized. V 

It should be noted that, Since the message is received via^the network 15, the display on the client terminals 13-2 
and 13-3 is delayed slightly behind the display on the client terminals 13-1. However, the client terminal 13-1 transmits; 1 - 

40 the message immediately after generating the Same, the display on air client terminals is driven generally in synchroni- 
zation in practice. The server terminal 11 transmits the message to the client terminals 13-2 and 13-3 generally at the 1 - 
same time, SO: that it is assumed that the display on the client terminals 13^2 and 13-3 is driven generaHy'in synchroni- 
zation. [■ ; t . ' .. <\< 5 v>. ■ -\ • . >\. • ■ .. .; 1 

FIG. 13 shows the processing s be performed when; the client terminals. 13-1 through 13-1 receive the message 1; 

45 To be more specific, in the first step S1 , the object to be movedis read from the object ID of the movement message 
nurrtber 1 : and the object thus read is set. Then, in steps S2 and S3, the direction :and velocity specified by the param- 
eters of the movement message are read 'and set. Therir in step ^ S4i the image data are generated which move the ' 
object-set in step S1 in the direction set in step 2 at the velocity set in step S3; The generated image data are outputted 
to the display device 45 to be displayed. : . - ; 7 ;. . - , . , : , .■ < ' ,-y-y 

so Then, in step S5, it is determined whether the period specified in the movement message has passed or not If the 
period has not passed, then, back in step S4, the processing for moving the object is continued.^ Thus, the movement 
(update) of the object is continued until the.period specified; in the movement message passes - ■ » : i . 

If the period specified in the movement message has been found passed in step S5, then, in step S6jit is deters 
mined whether another message has been entered or< not If there is any other message, then, in step S7,. the object 

55 kept moving so far 1 is stopped. If another message has been found in step S6. then ; in step S8, ! the processing of the-' 
new message is performed. This allows to move the conical object-101 for example during a specific period, followed 
by the execution of next processing; * < «■ : ^ - -?* r. . : c 

If a movement message is entered again as a next message, the object is moved for a further specific period. - : 
In what follows, the movement of an avatar in a more complex manner will be described. As shown in F\G. 14 ; /it is 
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assumed that the virtual reality space in which the conical object 101, the quadrangular prtem op\ect J0$, w6 the^cyjjn- 
drica! object 103 exist contains avatars C through E corresponding tc the client tenpnals 1'3- : 1 .ihrQug^! J 3-3. r^P&> ' 
tively. _ r v - : ^ ^'.'vy.p'- - % .r^' 

Now, it is assumed that^ in the client terminal 13-3, an operation. is made op the mouse 4$b to move the avatar E 
in the direction indicated by the arrow in FIG. 14. At this moment, in response to this operation, the CPU 41 of the client 
terminal, 1 3-3 generates an avatar movement message of number 3 shown ia FIG. 9 r Narnely.'as ah avatar J&nMpdpte 
object) to moved* the object ip for the avatar E is set. Also, the,c|irectioa in vvhich the avaitar is moyed and the 6\s- r 
tance of the mqvementare set corresponding to the inputs from the input device 4$. Further; fertile, srot^catiohs of r 
the arms (sub objects) and legs (sub objects), of the, avatar E, the numbe/ qf. fluctuation, times p%unit time js set as ; 
required. Unless especially specified; a default is set forthe ; numberofflu^uation times v ^ , ^ .... ... 

The above-mentioned . avatar movement message if exequted .on the dientterrhirial 1^t3 ahd,,at thie ^same.tirhe^ 
transmitted to the client terminals -1.3-^ ; apd 13-2 via the server terminal 1 i-1 at the.sarne time tq be.execihed , as>hown 
in the flowchart Of FSG= 15.:^,. v >. .>-"v ^:yjy : •■■ i *\ -r '-<• "> . ' ? *.- s ;^ ! - i » ■ -v. r. rr'i h 

To be more specific, the client terminals 13-1 through 13-3 start a program showri r in FI<3L 1 5 at the s^me time. In 
step S21, the object ID is read from the avatar -movement message and the object ID thu^ reaci js set In step. 3^. this 
movement directionis set. ; ,.\ : . u < ; j . . / ; ^ 1 - ; .\ ^ 

.Further, in step S23 (an update sequence), the image data in the case ^in which the bbject s<et in step S21 [ is. moved , 
in the. direction set in, step S22 are generated. The generated image data are.putputted to thj^ Jis^ay de^ce 45 to ^q 
displayed. 

Thus, the avatar E moves on the display devices of the client terminals 13-1 through 13-3 in synchronization. t r . 

In addition, in steps S24 and S25, the movement processing operations of the arms and leg?;, ind^endent objects, 
are performed. .*-> < m > > t"-.v,-. t : -. ^ ...i .-y *- . : ~> ■ 

s Details of the* processing of arm fluctuating movement (an update .sequence) are shown in ^he flowchart of Rp. 16. 
First, in step S41 , the r.umber,of< times the arm fluctuates is read from, the, specifications of the avatar movement mes- 
sage and the .number thus r;ead is set. Then, in step S42, the image for fluctuating trie arms of the object (in this case, 
the armsiof the avatar E) by the number of^times set in step §41 is gener^ted^The.gen^rated image is o^utted^tb the , 
display device 45 to be displayed. ; - : . ... ; i; ... j? -. r - ;M ; *-■--, : ; 

Thus, when the avatar E js rnoyed in step S23 of FIG. 15. the image in which the arrns of the avatar E (in this case, 
apartof theplurality of. objects constituting the avatar E) fluctuate back and forth is displ^^^ ;3 , ; r - r» 

Details of the processing of leg fluctuating movement (an update sequence) are shown in the flowchart of FIG. 17. 
In step S51 . the number of times the leg fluctuates isread from the spepif ications of the ayataj- nciovement message and 
the number thus read.is set. Then, in step S52,.the GPU 41 generate? the image data for fluctuating the. legs pf the, . 
object (the avatar. E) by the number of times set in step S51. The generated imag^ data are putputted to the display . 
device 45 to be displayed. ■>,,, . - . ; v;- , .- A « ^-.f^Jv ^ x - k. r^^t;- • v^-,. .. - 

Thus,- when the avatar E is moved in step S23 of Fid r 15, r the image in which t^e hands are flyrtuated back and \ 
forth in step S24 and the legs are fluctuated alternately in step.,S25 : i& : dijE^laxgrJ. . . ; ^ iC - c .,-, -„ t_ (i , r I ^ 

By setting the number of fluctuation times per unit time of the arms and legs to specific valued different a^tarsxian 
be rnade.to move their arms and legs differently from : tbcse of qther; a y^ r ^ fPf ■^^ l ^^.^M l !:.^^f:- an< f a short 
avatar are walking ex a same velocity, setting the number. of 1)urtuation ,tim t h e J la s , j ayatgr ,tp;^ r ^nr^l|er 

value than that .of. the short -avatar can m^ke"the,.walking belMyipr.more f*atur^i.. . ,. : . 7 ,. r . : : f? . r - , v , - r - , 

For the number of fluctuation times ofcarn^-aMJegs,^ ?^? n ^^S^-P^^^^.'T^ 
command far the number of fluctuation ti mes^ ^of arms and Jegs,has been entered from the inputdevice 49 of the dient f 
terminal 13, or a command (an update sequence). for ~sjmp!y .moyipc a specific avatar in a specific direction has be^n^ 
entered, the:avatarjs displayed with its : arms and Jegs mqying in a .generally natural manner. r . ; - n ;/ 

-.Then, in step S26 of FIG: 15 from step S25, it is determined whether the moving (w^alking) avatar has ^ moved ^ by the 
distance set according to the specification in the avatar movement message. If the avatar is.four^nbt,hayjng^ 
the specified distance; then, back in step S23, the processing is repeeteri; namely the avatar is.rnade cpntinue walKing. 

In step S26. if .th3 avatar is found having walked the specif ied distance, then, in step S27, it is determined whether 
a next message has entered ( cr not. If no new message, is founds then; in step S28, ; the processing ^o stop.the moving , 
avatar is performed. This processing can bo performed by generating the stop message numbered 2 otFJlG. 9 for examr. . 
pie to execute the same, stopping the avatar , However, a setup can, also be made such that the walking sivatar can b^ Vf 
automatically stopped if there is no new message when the same has walked the specified distance (or the specified 
period). > - ; . 

; In step S27, if. the new message is found., then, in step S29; the processing specif ied in the new message is per- 
formed. Forexample. if the new message is the stop massage numbered 2. the stop processing is performed in step : , 
S29; thereby stopping the walking avatar. ^ - v . • . - . - r — : .- 0 f 

. Thus, the avatar can be moved with ease with a relatively small amountof communication and in a generally hatural 
manner.-.-i. <~ -^-* • * •• . .: ' • : ~ \. - ■, : \ ' . - ■ ; • :c>'"' ' \' 1 ""m.. 

It should be noted that the server terminal 11 * 1 controls the clock of the three^Jimensional yjrtual. reality space an^. 
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when a pr^ start message numbered 6 to each of the client terminals 13-1 

through 13-3. This^alsb allows theabbvemehtidned parade of the message numbered 6 to be implemented- only by " 
using message communication volume in the same processing shown in FIGS. 15 through 17. 

;Based on the ab'ovfe-^ of operations, more complex "behaviors can'also be implemented with 

s relatively small' amount* ^ : . : 1 .' ^ ( ■ 

"For exairipIS, ias shipwn in FIG. 18, jt is assumed that a sidewalk 112 is provided along a road 11 1 with a billboard " 
1 1 3 installed in th6 proximity of the sidewalk 1 12 in a virtual reality space;The billboard 1 13 is set up suOh that th§ same 
displays a predetermined advertisement when an avatar (avatar F irV FiG. 1 8) comes within a predetermined range. 
In this cise, th^ server terminal 11-i receives the positional data 6f the avatars from the client terminals 13-1 

w through 13-3 respectively to calculate the 1 instance between each avatararxJ the billboard 113. When the distance is' 
found smaller than a pf^etehrniried level/ the server terminal 11-1 generates the complex movement start message 
numbered 4 airid outjkjts ^ through 13-3. Upon receiving this implex 

movement start message, the CPU 41 of each of the client terminals 13-1 through 13-3 executes the processing (an - 
update s^UenCe) iiirijcated in . '' v%l : ^ f> v~ '• ' \n : • . r- 

is To be more specific, tii€t in step S61 1 the billboard V1 3 of FIG. 18 is turned on': Then, in step S62 f , predetermined 1 
characters and graphics for example are displayed on the billboard 113 according to a predetermined sequence. Then, 
in step S63, it is determined whether the complex movement stop message numbered 5 has been entered or not. If the 
complex movement stop message has not been found, then, back in step S62, the display on the billboard 113 is con- 
tinued. 

20 The server terminal 11-1 always monitors the distance between avatar F in the proximity of the billboard 1 1 3 ah the 
billboard 1 13. When this distance becomes greater than the preset level, the server terminal 11-1 (generates the 'com- 
plex movement stop message numbered 5 to output the same to the client terminals 13-1 through 1 3-3. 

Instep S63bf HG/19, upon reception of this- message, the GPU 41 of the client terminal 13 goes to step^S64 to 
turn off thie billboard '1131. Namely, the corriplex movement performed oh the billboard 1 1 3 is stopped^ " >v 

25 Thus; even tor complex 'movements (Ufidate sequences);' simply registering the same^in the client terminals 13-1 
through 13-3 in advance aiiows the client terminals 1 13 : 1thrbugh 1 3-3'to display complex movement images simply by 
outputting a message for indicating their start to the client terminals 13-1 through 13-3. ^ ; v>. i 

In the above-mentioned embodiment, the two server terminals and the three client terminals are connected via the" 
network. It will be apparent to those skilled in the art that the number of terminals and networks is hot limited to these 

30 values. * . v ; fc * '"' " 1 '* '" ,-i ' / ~ b ' ' ,: v - ' ■ ! ' * • ■' 

It should be rioted that displaying avatars C thrbugh'F in addition to the above-mentioned conical object 101, the 
quadrangular prism object h 02, and the cylindrical object 103 also requires objects that provide a background: The 
basic states of the background objects are not subject to change, so that these objects are referred to as basic objects 
as contrasted with the update objects of which states are subject to change. A background image formed by" basic 

35 objects is supplied 4 from the server terminal 11 to the client terminal 13 via the Internet. Therefore/ the update objects 
are displayed superimposed on the background iriiage (basic objects). " A 1 - 

■ Meanwhile, in the ^ove-merrtibhed relate art Habitat, an animation in which ah avatar moves while fluctuating its 
arms arid Tegs orYa two-dimensibhat background is' displayed when thecursor is moved to a target position to which an 
avatar is to be rricved, the mouse buttbh is kept pressed on that position to dispiaiy a mouse command (a pop-up menu);* 

ao and "GO" command in the pop-up menu is dickeo. However? this is the display in which the avatar created by two-L 
dimensional graphics is superjmpbsed ori"the background image created by two^imensiohal graphics, namely the dis- 
play based on the animation created by a series of celluloid pictures in which bit map data representing different direct 
tions of the arms and legs are alter hately read bu^ aS tlie avatiar moves along. 1 j 

Namely, in Habitat, a two-dimensional virtual reality space can be viewed only from a position viewing over the 

45 entire space including one's own avatar from the viewpoint of a third person. Therefore,* it is impossible for Habitat to 
change : viewpointe or represent a depth. : • ^ r • ■ ■ * v . „ 

1 Gn the contrary, 7 in the i above-mentioned enSbodiment of the" present invention, the update sequences of the aya< 
tar's arms ahd legs (each sub object) may be definedin aidvahce such that the update sequences interlock with each 
other. This allows the avatar to perform a variety of behaviors which are minutely different from each other according to 

so the attributes of the avatar simply by giving a message "walk" for example to the avatar (for example, a male avatar is; 
made walk with a big stride while a female avatar with a small ; : feminine stride). ^ 1 ; - - ' 

' It should be rioted that the data of each object are defined as a VRMLfilie or an E-VRML file, details of which will 
be described later. ^ - 

In the above-mentioned embodiment of Xhe present invention, each client terminal 13 moves its object. It is also 

55 possible to display oh each client terminal the image of a virtual're'ality space seen from the viewpoint of each corre- 
sponding avatar. When the viewpoint is moved on each client terminal, the background image changes corresponding 
to the viewpoint. If an avater of another client terrriihal is found within the view field range seen from that viewpoint, that 
avatar is displayed. Therefore, the avatar display state is a result of the composition of a movement command from that 
client terminal to that avatar. This makes control df the display more complex. . .. i ' ' » . . 
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RG 20 shows a mors concrete. examrteof the constitution of a cyberspace.sy^rn t,^c v , ^thG,internr 1 t • 
prefer* ^rrt^mert; on* cf*e above-motioned server terminals 1 1 ; -1 and -ir 2;(for ^ernp!e.-th<?: server terrnpl ; - 
U-V- used ss an infomaaon server terminaland the other (the serveriterminaM"^) is used as iar^^^Xe^ 
minEl/lr^na; follows, *e^^^ 

terminal 1 1 -2 denotes the shared server terminal 1 1 B. ; ' " v l ' : ' :i Vr '■ ; 

A host A constitutes * systern.of.Sie VWW (World -Wide Web),tor ^^^^^S^S^^ 
a file) to be described later. And. each piece of infcrmation(or each file) is related 

tor) ^uniformly specify that information. . SpecKying a URL allows access to the informaton ^a^^to^. .: 

To be niore specif ic. the host A stores three :diniensional irnsge data for providing thrse-dirTi}Snsionalyii^al real.ty h 
spaces (he. einafter.appropriately:referred to simpiyssvirtual reality spaces) such as yirtualstreetC: in?Tokyo, , ^ 5 '^ Y '> 

state- that i S> *hese data include,stafe. data.consisting of only basic ob,ects ; such ss^buikli^.^ ; toad toba sh?reu u; 

bya^purSiJofusers^^ 

.Lstaticdata,areconsid.^J tobe data that are not sub^ 
in^a. 1 1 A (a basic Se ,v e r,termin,3l),TheJnformation server terminal 11 A isradapted, when the sarr^rece^s a URL 
v^ the network 15, to provide the inforrmtion corresponding 

soacp (in th'-s case, aspace consisting of onlyibasic objects). .. ■'• : ; : v • r; . ' ' 

^ .t should blnoted^at. in FIG. 20 there is on* one host; namely the host A, which has an ^rmaT,on^ent^ , , 
mina! for providing the virtual reality space (consisting of only basic objects)^ a specrf .e area. It is apparent that such 

3 ^S^Sa^^ update^e^hat^ute;, 
a virtual realty space xvhen put in. it. The update objects are avatars for .sample 
nalsThus the shared sorter 'terminal 

a^foT'exanpie Tokyo) oithe virtual realU 

viS realHyspace of a specific area. Also, it should be noted that the network^^connected w* .n.add t onto the 
SS: S5oit *t shown, having a. shared serve, terminalfor controlling update objects .located ,n virtua! real.ty.spaces 
of otheraraas such as New York and London; stored in the host A.,. r . - r j ■ ' .V' '1 d '"~'"L~n- 

Thost C?.ike the hotfA. constitutes a WWW system for example and stores data f ^ ,P rt <'i^S2?S 
addresses for addressing hosts (shared server terminals) that control update .objects lto.the^ B < .Ther*^e., 
shared server terminal addresses stored in the host G;are unifor«ily:related.with:URLs as.wsth.the case of the host-A, 
as wrZZ Z^n addition, the host C has a mapping server terminal 12 (a control server term.nal). M 
URL via the network 15, the mapping server forming 2 provides the:. R address of the-.stered^te^oon^ 
spondiny to the received U R L viathe network .1 5; It shouttbe noted that BS. 20 shows only one host, namely^hoa 
rTwWch has T the mapping server terminal 12 for providing shared server terminal addresses, .t^!! be apparerrttha! tte.. 

^fhe^SS^ 

via the network 15 to share the received virtual i-eality space with !0 lh 2 rrd 
terminal 14) umler me control erf :the sh^ 

receivespecKic services (informaticn)uang e,e virt U al reality.spac.vifrom theservice.provkior term.na! 

The service provider iermihal ,14, like the client terminals. ^ceives a virtual realrty.spaceto share the same-wtfu - 
the clientiierminal 13 (if .there is another. sewtee provider terminal^ also shares thi S : S pace),^erefore; as farast.*., 
capability of this portion ^concerned; the service piovider terminals is the same as the client^ minal - - 

Further, the service provider terminal 1 4 is adapted to provide specific services to the chert termmal £ . sho^l 
be noted.that.FIG: 20 shows only one service provider terminal 14r It will be apparent that the semce.prov.der.tc.^.nal 

^t£'^^^ 

WWW is one of the systems for providing information from hosts X. Y. and Z to "^^^.^j*™^ Z 
the networks (the Internet* the case of the WWW), The information that can be provided in th.s bystem^r^ude^ot 
only texts b<rt also graphics, irmges (including still i 

hyper texts which combines all these information. •" • c .1" ■ jo 

In** WWW a URL or a form for unHormlyTepvesent these pieces.of information is determmed^Speafying a spe- 
cie URL; each user can-obtain the information corresponding to the specrtied^URL Asshown in FIGL22 eachURL e ; 
composed of a protocol type ior' representing a service type (http in the preferreo embodiment of Flo 22. wh|ch^ 
2Srtto-a^^ 

file) a host name indicating a destination of the URL (in the' embodiment of FIG. 22, www.csl.sony.co.ip). .and ^ We. 
name of data to be sent (in the embodiment of FIG. 22. indexhtml) for example. - J. Z % ..^ 

P^ser operates the diert terminal to erter a URL fo^ 
terminal references a host name; for example, contained in the URL A link with a host (m the embodiment of FIG. 21; 
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the hdst'X ftSr exa^l^ c«Pirt§ea$fJ tdtfcelmeri%t) Addressed by the hosrhame^ established: Then, at the dieht termi- 
nal, the'UFtL i&senWbil^tinked h<^t>rferrteiy the host^X, via the'lnternet, requestingithe host?X forsending the intorO 
mation specified in ffe UFtLC \ft the hos'tO^ar* HTTP demon (httpd) is operatingon the infer mation^erver terminal (the r 
WWW server terrhinaiJJ deceiving ^ the^l^ ^kTformation^ser^? terminal sends back ^ the^ntarma^on specif iedin the i 

5 URL to the client terminal via the Internet. - L;^; > . .* t: r ;£ f ; 

The fclieht terminal receives *the infoWriaSdtt from thfe! infer matibri server t 6*rfti nallo display ^the receivedinfcrmation 
on its monitor as requireiinThusi'thfe user can gefthe dcfeired ipforrnation.**! ^ " ^ ; - .' ■ ■ f . 1 r- 

Therefbre, only stdfihtj ir? the host such data for descrfcing elSniejntsHobjects) for constituting a 4 virtual reality space 
as stapes of basic dbjecfs {feT'example; a rectangular prism and a CBrtefafUd locations and attributes (color andtexture 

10 for example) of: thes'e' basics ^obfefcte allows 10= provide thfe virtual reaWy^space (consisting of only, basic objects irifthis 
case) to unspecified users;*' NkrnSty; as long as the Internet is used -fof'the'network 15 and the WWW is used, virtual 
reality spaces can be ^6v^^ ^ unspscrtted users; world-wide with ease and at 'a low cost because the Internet itself J 
already^spans almost hllNcfcter wdrtdfand the description^ the elements:constitutirig each virtue realiry.space to be * 
stored in hosts 1 ctoeisintft f^uire to make changtes to: information servers f WWW^ server ; terminals) constituting < the 

75 WWW. It'shOuId be noted that the service for providing ?the; description of the; elements constituting a virtual reality 
space- is upward compatible with existing services provided: by the WWW ic . , ,r. 1. , : J ! j ? 

Storing in a specific host (a mapping server terminal) the IP addressesof other hosts" as information also allows to\ 
provide the host IP addresses : to unspecified users world-wide with ease. * ^ - j '■•"■! ■. !i. 

It should be noted that it is difficult tor a plurality of uisers to share the same virtual reality space if dhly the descr ip^ 

20 tion (the data of three-dimensional image for providing the virtual reality space of a specific area) of elements constitut- 
ing the virtual'^eality space -is stored; in. a- host constituting the WWW! Namely, in the WWW, the information 
corresponding to a URL isonly provided to:a Juser*and therefore no control for information transfer- is performed. Hence; 
it is^difficurt to transfer between users the; above-mentioned chahg conformation of update objects by using the WWW 1 
withbiit changing its design. Therefore, in the^cyberspace system ofrFIG. 20; the" host B having the sharedserver ter- 1 

25 minaf^l I B&nd the host G having the mapping. server 12 are installed to: allow a plurality of users to share. the' same vir-;. 
tuabreaJityrspiace, details of which will be described taler. r r > . :i» : - r^!.\ ; :/ ,-; - l t ^ - f ^ 

:FIG. 23 show&an example of.th6 constitution of the mapping server terminal , 12 operating on the host G of FIG. 20> 
Components CPU 91 through communication device 94 ate generally the same: in constitution as those of FIG. 2, so 
that( thB description of the components of FJG. 23 is omitted in general. A stbrage device 95 stores addresses, along 

30 with.URLisrtor identifying shared server terminals that control update objects (in the embodiment of FIG. 20, only the 
shaded server terminal 1 1;B is shown; actually,:oth6r shared server terminals, not shown, are-connected to the network 
15)x io.'j-: ^' ; .. *Vi ior tr..> ^ \ s?) y ~ l. - fW ■ 0 ' 7 :y' ■- ■'■ ,\ ' . ' 

The fdfowing describes the operations of the dient. terminal 13 (or the service provider terminal 14); the information 
server terminal 11 A, the mapping server terminal; 12, and the shared server terminal 1 1B with reference to the flow- 

35 chartS > Of-FIGS.'.24-through.27.-:?t- . - r: 1 : : - v;^- v.. . '.: \. -k . . ■: : J - . ■■ v-f-:^: ... * 

Now, referring to FIG. 24, there is shown an example of processing by the client terminal 13 (onthe.service provider , 
termihal : 14).'1n step S7t ; the CPU41 tehecksiwhether avirtual realty space URL has been entered or not. If no -virtual 
reality space URL has beeh fbundrthe processing rerrains iastep S71 . If a virtual reality space URL. has been found 
in sterX'S71/:namety,fif a virtual reality: space URL cc>rre$poriding to a desired virtual reality space entered by the user 

40 by operating the fceyboard 49a has been received by the G^U 41 via interface d; the'process goes to step S72. In stepyx 
S72,iayWWW system is constituted as describe!' with xeference to FJG. 2 1 r and the virtual reality space URL is trans- 
mitted from the comrnunication.deyice 44 via the nefewbrk 15 to the information server terminal of a specific host (in this 
case, the information server terminal 11 A' of the host A : for:example) that has the information server terminal, thereby, 
establishing a link; > ; ^t\: « .--■■-.;!■'/ :-v? r ■•':*r l -r c^^^i .■ . '^j. ■■ , , ■ - ■ -i^-. K"i 

45 'jFurther, in step 4 S21 ran address acquisition ;URL* related to the virtual reality space URL is.read.frorh the storage 
device 50 to be transmitted from the communication device 44 via the network 15 to the mapping server terminal; of 
specific host (in^this case, mapping serveMerminal -.1-2 of the host C for example) that constitutes the ^WWW System, 
thereby>eistablishingria linfc. ; ; b-: ; ^ --^ iv v ; t \ X - > - : «• t r ■ o ;: ■■. v-k i v\ 

i Theri-, the process goes to step S73. In step S73, : data.(threeKiimensional;image data) of the. virtual reality space 

so or the IPraddress of the shared server terminal 11 B corresponding to the virtual reality space URL. received in step;S72 , 
or the address acquisition URL is received by the communication device 44- : „ ~r,, 

Mamely, in step:S72, the victual reality spaed URL is transmitted to the information server terminal .1 1A. \When this 
virtual reality space URL is received by the infer mation server terminal 11 A, the data of the corresponding virtual reality 
space are transmitted 'to the clientterminal1.3 via thelnetwork 15 in ; step S92 of FIG. 25 to be described:. Thus, irtstep 

55 S73, the data of the virtual reality space transmitted from the information server. terminal 11 A are received. It should be 
noted that the received virtual reality space data are transferred tti> the RAM 43 to be stored there (or first stored in the . 
storage device 50 to be transferred to the RAM 43: ^ . ; . " l; ^ . . . : i • j 

iAIso, in step S72, the address acquisition URL is transmitted to the mapping server terminal 12. When the address 
acquisition URL is' received by the mapping server terminal .1 2, .the IP address of^ the; shared *server^terminal corre- ( 
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spondinp tc tl^eURLis transmitted to the-client terminal 13 via the network 15 in step SI 02 of -glO^gS-tp ba 5 dj^^il*B?J. 
Thus ; >: step Spi'.the !P a^res^ of the shared server terminal 1 1 B transmitted frpn ths mapping jseryer ,1 t 2 is repeiuecV 

Ae described: above, the egress acquisition URL. related tcthe entered virtual reality .spacer'JRK coiTesponds;tO' . 
the IP address of the shared server terminal that controls the update object placed jn the virtuahr&a;ity space coire- v ' 
s sponding to that virtual realty soace URL. Therefore, for example, rf,the, entered virtual reality N spacpJJR|L corresponds 
to a virtual reality space ; pf Tokyo and the shared server terminal "MB owned byti^ 

placed in Jhe Tokyp virtual reality space, thp IP addresspf the shared server terminal 11 B is receh/ed in st^p S73. Cpn- ; : 
sequently, the user can automatically get, the location (the IF? ; address) of the shared serverterminal that : rantro<s then : 
virtual reality, space of a desired area even if theuser does not know which shared server terminal cpn^ols the -updaten:> 
10 objects in a virtual realty space in which area. :Vi JV , ^ - ; .\ • ; ^-r \ : : l, :>y :zb VrJC' ^c - w-nna er^>i: 

It should be noted that, in steps S72 and,S73, ^processing of transmitting -the; vj^a| v ^.^ : £9)ace URL and. the :}r 
address acquisition URL and recervingthe visual reality space data, and the IF? address is actuaEiy: performed by- trans- 
mitting the mrtuaLreaiity space corresponding yjrtual reaijty space,; transmitting the > 
address acquisition URL, and then receiving the corresponding IP address in this order by way of example,. ; ; 
75 When the virtualreplity space data and ihe^shared server terming! IP address are repeivedin ,step S73, the process 
goes to step S74. Jn step S74, a connection request is transmitted from the communication device 44 via the. network . £ 
15 to the shared server terminal (in this case, the shared server terminal 11 B for example) correspondjng.tp' the: JP. r . : 
address (the shared server terminal IP address) received in step S73. This establishes a link between the client termi- 
nal 13 and the shared server termina' UR. Further, in step S73, after the establishment of,the link, Jthe avatar (namely, 
20 the ujxjate object) representinct^oneself stored in the storage device 50 is transmitted from the communicaticn : de/ice . 
44 to the shared server terminal 11B. : : > ^ -a . * - v i^ . ^ :? x.-oio - >n* :^ 

When the sharer 1 server termina 1 11 B receives the user's avatar, the same is then transmitted to the client termjncJs 
of other use's existing <n the same virtual reality space (in this case, that of Tokyo as mention^ above). Then, on, the 
client terminals of ^othe-, users, the transmitted avatar is placetfin the virtual reality space, thus implementing the sharing 
25 of the same yirtu;al reality. s^ace among a plurality of users. , r y -. , ^ ^ns : ^ , : - ; v i : 

It should be noted that, lather t^ian providing the user's avatar from the client- te^minaL1 1 B to the shared server ter- - t 
minaU \1&,-<a .predetermined ayatarmay also be allocated v frorn ?he : shared server terminal 11 B to each userwho 
accessed the sarna Also, in the client terminal 13, the avatar pf 1 the .user ; himself who les this terminal can be placed . 
and displayed jn the virtua! reality space as. shown in FIGS 36 and 37; in the real world; however, the user cannot see 
30 himself , so that A is desirable for the, user's avatar no| be displayed on that user's client terminal in order ; to make the 
virtual reality space as real as possible. -.. v: v ^ ^ 0 v v ; o v . ^ , f v : 

When the processing pfstep S74 has been completed, the prpcess goes to step S75. Jn step.STS^thedata of the 
virtual reality space .thatcan be seen when the same.is seen from.specific viewpoint and position are read;frpm the 
RAM 43 by the CPU 41 to be supplied to: the display device 45,. Th^s.^the specific virtual reality space; is shwn:pn;th@ ; y 
35 display device 45. > ; » ~-. y ■ . . v- xh -x: * >v- j> *s z;,^ v»- .< • £ ^ -X- 'c^Xcr;--. Ar'HX Mor : ^upr 
Then. in step S76, the communication device 4^ determines whetb 
has been sent from Itie shared serverterminal 11B. ^ok; be - - ^ ^ J: ' *. t, x\ :v 0 3 c. : y... 

As described above.-the user can update, the position or yiewppjnj of ( his own avatar by operating ^h^yiewppirt 
input fierce 49c, .tha movement inpirt deyjce ^Sd pr s mouse 49b. : Jf the ;update of frie position or vieApointo* the a^/atar : 
40 is instructed by using this capability; the GPU 41;r£ceiyes.th£ 

tion, "the CPU 41 performs processing for outputting ppsitippa! data ; *pr ; v?evypoint:data corresponding to the updated- 
position or yiev/point as update information; to the shared server termiiia? 1-1 B. In other words, the CRU. 41 controls the 
communication device 44 to transmit the update infprmation to.the shared ( seryer terminaLU Bo -r^ * ' o:> '.: - ^ 
Receiving the update information from the client terminali the shared server termina! 1 1 B outputs theiupdate infor- 
ms matipn to other client terminals in step S1 14 of FIG. 27 to be described. It should be noted the ; shared server terminal 
1 1 B Is adapted to transmit the avatar, received, from the : client terminal that requested for access to client terminals, of , 
other usersi this avatar being transmitted al^as update jnformation. v>f ; . r . - 1 * * r f ; - ^ 

^tien . the update. ipforma^ has come as mentioned : above b it is determined in step S76 that update information o 
of th9, avatarf of another user has come from the shared, server terminal 1 1 B. In this case, this update information is o 
so received by the communication deyice 44 to be putputted to the CPU 41 . The CPU 41 updates the display on the display . 
device 45 according to the update information in step S77. That ss, : if the CPU 41 receives the positional data or view- 
point data from another client terminal as update, information, the.CPU 41 moves or changes (for example, the orienta- 
tion of the avatar) the avatar of that user according to the received positional data.or viewpo-nt data. In addition, if the 
CPU 41 receives the ; avatar from another ciienti terminal, the CPU 41 places the received, avatar in. the currently dis-- 
55 played virtual reality space^at a specific position. It should be noted that when the shared server terminal IIBtransmits 
an avatac as update, information the shared serverjterminai alsc transmits the positional data and viewpoint data of the 
avatar a|png .with the, ipdate information. The avatar is displayed on the .display device 45 according to these positional 
data and viewpoint data. . .: , • ■ : > c . ^ : - ^ ; : ' : :-» ' ' :i 
Men tha above-mentioned processing has com the prpcess.goes tostep.S78,;:^ \o r ^ -xx^- 
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Weanwftfl^ update iWorrfiatidrii bt the avatar of another user Has conie frbrn the 'shared sferver : 5 
terminal T4B, trie pYoces&gbes to s^ st&p S77. in step S78, the CPU ^VdeterVrrhieS whether ^e p6si- r * * 

tiomorc viewpoint of tHbaVatar of th&user bf the client terminal r3 has been updated or net by operating {he view^osht 
input device. 49c orithe'rhovement input' device 49tf. ^ ' ^ • ^ ^ :- . 'f v; *. . t \" ^ K u &vl; 

s Mh step S7S, i$ thfe^EPU 41 determinife^h^t tHW^vatar pcfeitibn or viewpoint has been updat^cli namely, if the view- ;! 
poirrtlri^utdevice 4'9c^ been Operated by the user, the process goes to step S79. i: ; 

In step S79, the GPU 41 reads data of ! the virtual reality %pa<^ corresponding to the position and viewpoint of the avafar^ 1 
of the usbr based On fFfe entered posftionaldata and viewpoint data, makes calculations for correction as required;! and' ; 
generates the irriaige^^^ aVidViewjpoiht: Then, the CPU 41 outputs the generated 

10 image data to the display device 45. Thus, the image (virtual reality space) corresponding to the viewpoint and position 
entered from trie vi&tfpio^^^ input'devtce'49d i^ displayed on'the display device 45. 

-Further? in &ep'S8^&#CPli 4l%&ntrote the communifcatibn dfevide ! 44' to transmit the viewpoint data or the posi- 
tional d£te entered frdrrVthe viewpoint input device 49c or the rhbvemerit input devfcb49d tbthe shiared server Wminal 
11. upon whichpfbceSs gbes to'step-SBI.'"*' : ; : ; '-<~' JS / ]l " ' ' u *"-'" ' JVr< '- .. :,( >v:?*:--y ■.-«-;. .j*J rf*; 

75 Here, as ; desCribled above, toe 'update information coming from the client iermiri&P H 3 : is VeceivecTby the shared 
server teVminartlB to beoutputtil to other clielnt terminals. Thuis, tlWavatar of the user of thfe client teri mihal 13 is dis- 
played bh the^otherlc^ienft terminals: H - ^ ^ : >' r» ? ^r: r . ; . : . - :i \ ' 

On the other hand, in step S78, if CPU 41 determines that ihe avatar's position or viewpoint has- not bebn updated, 
the process- goes to step S81 by skipping siteps S79 and S80.* In step S81 /the CPU 41 determines wKether the fend of 

20 the update data Input operation has been instructed by operating a predetermined key bh the keyboard; if the' end has ? 
not been instructed, the process goes back to step S76 to repeat the processing. * ;i - 1 v - ° - - ■ " ' * ' * 

Referring fb the flowchart of FIG. 25, there is shdwrrah example of the processing bythe information server termi- 
nal f f A ; ." First, in the information server tevfnihal 11 A{ the^cornmunication device 24 determines^ step S91 , whether a u 
virtual reality spate 'URL has come- from the' didnt termirtaP 13 via the network 15. It. in step JS9lVtHe bbmmuriicatioh 

25 device 24 determines that no virtual reality space URL has come, the process g66s back to step S91 If the virtual r^l^ 
ity space URL has -come,* the" same is received by the cbrrimuhicaition device 24yupori which the process igoes to step 
S92. ( In Step S92Hhe 'data t of the virtual reaiity space reiated : to the virtual reality space URL received by the communi- 1 • 
cation dfevice*24 are read by the CPU 21 to'be transmitted via the network 15 to the client terminal 13 thaitransrriitteci^ 
the virtual reality space URL. Then, the process goes back to step S91 td repeat the above-mentioned prociessing. iV 

30 FIG. 26 shows an Example of the processing by the mapping server terminal 1 2. In the mapping server terminal 12, 
the communication device 24 determines in step S101 , whether an address acquisition URL has come from the 'client ; 
terminal 13'via' the network 15. ff rib 'address acquisition URL has come; the process goes back to step S101. If the 
addregs'acqiliisition URL has ^corne^the scime is Yeceiv^ : by 1 the communication device 24; upon which the process 
goes r to f Step S1 02. In step S 1 02 j the I P address {the IP' eiddress of the 5 shared seirver terminal related to the : address 

35 acquisition URL received by the communication device 24 is read from the storage device 30 by the CPU 21 to be trans- 
mitted via- the network 15 to the client terminal V3 that ^trarrsmitted the address acquisition URL.-Then, the process goes 
back to step S1 01 to repeat the above-mentioned processing. * ; - ^ r. ; f . - ^ - 

- F IG: 27 shows ah example of th^processing by the shared server terminal 1 1 B. ln the shared server terminal i 1B; 
the cbmmurfFcation device 24 det6rminres, in step -81=11? wKethera connection request has come from' the client termi- ' 

40 nal 13 via'the h^Ork-15. If no coriiliection^^u^ the process go6s to istep S1 1 3 by skipping ■ ! 

step S1 1 2. rf the conhWcrtion ret|uesf tias oorhe iri step : SI 1 1 , th&t isT if the clierit terminal i 3 : fias the connection reqCi'e^t ! r ' ?; 
to the shared server 1 terminal 11B in' step S74 of FIG724; the cbmmunicatFon link with i fhe client terminal 13 is estab- ; 
lished by the communication device 24,- "upon which the process gjoes to step S1 12. 4 ;F : " " v ^ 0 1 
-In step S112f abdnnectibri control table stored in the* RAM 23 is updated by the GPU 21: Namely it-is necessary 

45 for tlie shared server terminal 11 B io recognize' the' client 'terminal 13-wTth which* the 5 shared server terminal 1TB is ;;r ' 
linked, in order- to -transmit update information comihg fro'm the client terminal 13 to other client termihalis: To db ; s5' t ?l 
when the communication link with client terminals has been established, the shared server terminal 1 TB registers the • 
information for identifying the linkedblient termirial^rt the con hectibh control table. That is, trie connection control feble 
providdsra list of the client terminals currehtly finked 'tb'the 1 shared* server terminarUB; The iriforrnatibn for identifying t: 

so the Client terminals include the source IP address frarismitted ff bmeach dient terminal as the header of TCP/IP packet : 
and a nickname of the avatar set by the user of each cliehtlerminal. ^ v ! * ' s - - ^ v : • ' ' , > 

Then,' the process goes to step S1 13, in whic^ihe communication ^ device 24 determines whether the update infer- • 
matioh has come from the client terminal 1 3. Hi ; irVstep^ST 13, ho update information has been found, the process goes v 
to step S1 15 by skipping step S1 14. If the update information hais been found in st6p ST1 3. namely, if the client terminal ; ' 1 * 

55 13 has transmittedrin step S80 of FIG: 24; positional data iand viewpoint data as the update information to the shared c 
server terminal 1 1 B (or, in step S74 of FIG: 24- the client terminal" 13 has transmitted the avatar as the update informa- ri 
tion ; to the shared Server terminal T1B after transmission of the connection request), the update information is recfeived 
by the communication device 24, upon which the process goes to step S1 14. In step S1 14, the CPU 21 references the 
connection control table stored in the RAM 23 tb transmit the update information received by theborhmuriication device 
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24 to other client terminals than the client terminal which transmitted that update finfornt&tio;^ : - 
source-IP address ofieach c!i(^j£:minal ; cp!^ro!l^d by-the connection control table is .used. o^-; .r; , - ; : ~r.\ j 

! : should be noted that the abov^i-mentioned update information is;repeived bytths cKer 'lerryuna* 1 3-in step S7€ of K 
FIG. 24 as described above. At this moment, the IP address of the source of each client terminal controlled by the con- 
nection control table is used- ; :? . v. v - v 7 . ■ s - 1 ; % 

Then- the process goes to step S115,;invt£iich thrJGRU.21 determines whether the end of ;proc ^ir;g has beer 
instructed by the client terminal 13. H the end of processing has not been instructed, theprrcess.QoesbacktoSI'l by ' 
skipping step S1 16. If the ond of processing has.taen iostructed f rLhe.process goes to step SM 6; ; In step S1 16,.tt;e lirk 
with the client terminal 13 from which the iristructionttas come is disconnected by the communication device 24:, Fur-, 
ther, from the connection control table, the information associated with the client terminal 13 is deleted by the GPU 21, k 
upon which the process goes back to step 3,111. /: ;> > J * : r >:>l w ? tuXj t?*xfo o'^i n't .\ ^r.n 

It shcu!d be noted that the upd^te^LiformattonJs. appropriateiy/tiansmittedjas^a message (FIGi 9) as described - 
above. .r-sr '"^i- >•.>■■■ -\:- en; v> \ nj- < {."- t r ; o \- m ?v 5f - -i? «:&.•<: u-w.-. ^ - 

Thus, the control? of the update objects is performed by the shared server terminaM I B anditie control (or provision) 
of the basic objects is performed byithe information servers terminal 11 Af constituting the WWW of the Internetrused : 
world-wide, thereby easily providing virtual reality spaces that can be shared by unspecified users world-wide. It should : 
be ncted thafthe specifications of the existing WWW system need riot.be: pnodtfied to achieve the above-mentioned 
objective.' . : ■ ■ r^-^-.T, • r< • '■.'>*■.-■. r -' * ■ * ^ >- .'*o? v ■ • ^ . \~ 

Provision of the virtual reality space data by use of the WWW system need not create any new web browser * 
because the transfer of these data can be made using related art web browsers such as:the Netscape Navigator, (trade- 
mark) offered by Netscape Communications, : Inc. for example. ? V -v, . - ; , ? ;r 

Moreover, because the IP address of the shared server terminal 1.-3 BJs provided by the mapping server terminal 
1 2, the user can shar e a virtual reality space with other users without knowing the address of the shared server terminal 

In therabove-mentioned- preferred embodimenis of the invention, the basic objectsrsre.suppli5ed:t6 each client ter- 
minal 13 via^the network 15; however, r: is slso possible to store the basicobjects in an information recording medium 
such as a CD-ROM and distribute the same to each user in advance. In this case, each client terminal 1 3Js constituted 
as showr. in FfG. 28 To be more specific, in the embodiment of FIG. 28, a CD-ROM drive 100 is connected^ the inter- 
face 48 to drive a CDr RGr\k1 01 in which a virtual reality "composed of basic objects is stored. The other part of the con- 
stitution is the same as that of FIG. 3:- 7 - ; " ' ; i ' * f v> ? : ^ : * - 

Thus, provision of the data of basic objects from the CD-ROM 101 eliminates the time for transferring the data vis 
the network 15i< irfcr easing processing speed, ^ • : o ■ ; ; M ^ : { *.v "'• ^ " :J: ; T . : ; ; . 

Alternatively, the data of basic objects supplied from the information server terminal 1 1 A may be stored in the stcr^ 
age device 5G only for the first time to be*subsequently read fonuse. ^ ro >^/;r, ' . /V^V ^ -r>.^ -^•^^^^ ^ 

Namely, as shown in FIG. 29, the basic object diata can be stored in the'storage device 30 of the information server ? 
terminal 11A (for ttie cases 1 through 3), the storage device. 50 of tHie client ^terminalvl 3 (for the cases 4 through 6) or 
the CD-ROM 101 of the client terminal 13 (for the cases 7 through:9)^: - -5 ; - *-=;.; cr5 ^ -"'••'^ • ^ '>- HJ ; : - 

On the other hand, the update object data can be stored in the storage device 30 of the information server terminal * 
1 1 A (ior the case i)~or the storage device 30 of the: shared server terminal -1 I B (for t ie cases 2 through 9): in the^case 
in which th^ update object data are stored in: the- shared server terminal 1 1B; : that shared server terminal may be the 
shared sen»er termini 11 B^t in Japan s (ibr the catse^^ l lB-2 in US (for the case 

3, 6 or 9) as shown in FIG. 30 for example. In this instance, the URL of the update object data is stored on the mappii-j > 
server termha! 12. . " ] ( ^•■o-- ..-r.^-^u ;'V n\y..-rJ: m : t vv ^.y-..- -tu ^; <y--^:-l . ,-; ; , . t..-:->v 

It the update object datai are stored on the information server 'terminal 11 A, the URL of the update object data" is 
the default URL controlled by the information server terminal- 11 A (in the case of 1): Or if the shared server terminal/! I B 
is specified by ths* user manually, the URL c I update object data is the^spbeified URL (in the case of 4 or 7) 1 ."" - 1 

Referring to F4G. 30, the data in each of the above-mentioned cases cf FIG: 29 flows as follows, in the case I, 'A\e 
basic object data are read from a VRML file (to be described later in detail) stored in an HDD (Hard Disk Drive), storage 
device of a WWW server terminal 121 operating as the information server terminal 1 1 B to be supplied to the client ter- 
minal 13-1 for example via the Internet 15A operating as *2he network 15. The storage device of the WWW server ter- 
minal 121 also stores update object data. To be more specific, when the basic object data are read in the WWW server 
terminal 121 , the URL of the corresponding update object data is stored as the default URL in the storage device of the 
WWW server terminal 121 in advance. From this default URL, the update object data are read to be supplied to the cli- 
ent tei-minal 13-1. ' - ' ••j-., ••.j.? • ' . f ^' ■ j i J . •. . -~ •-• 

in the case 2. the basic object data are supplied from the WWW server, terminal 121 to the client terminal 13-1 in 
Japan via the Internet 1 5A. On the other hand, the update object data are supplied from the shared server terminal 1 1 B- 
1 in Japan specified by the mapping server terminal 12 to the client terminal 13-1 via the Internet 15A. 

In the case 3, the basic object data are supplied from the WWW server terminal 1 21 to the client terminal 1 3-2 in 
US via the Internet 1 5A. The update object data are supplied from the shared server terminal 1 1 -2 in US specified by 
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the .mapping se^er le^^ 15A. 

In the case 4, the basic object cfite are stored in advance in the storage-tfevice 50 of the client ; t^JTrfnWl i3- : 1 : W r 
Japan for example:- The* update objeet'data are supplied: from the shared server terminal 1 1 -2 in US for example sped 1 
ified by the cljent ferrtiinaR13-1 . ! ■ ■» . J r ; . \s . ! ■ "':or: r. - *s .C; 

5 In the case 5, the basic object data are stored in advance in the storage device 50 of the client terminaM3-t;:The;: 

update object data are supplied from thg shared server terminal 11 B-1 in Jfcpan specified by the mapping server terrriT- 
nal\12 via the Inter hefctSAV:; > ^ < . : ; ?* >h<:±ir'r?\ ■ «> - j. 'v. 

1 1n the case 6, the basic object data are stored in advance in the storageideyjce 50 of the client terminal 1 3-2 in US. 
The updates object data are supplied from the shared server terminal 1-2 in US specified by the mapping server termi- - . 
io nal 12 tolhe client terminal 13-2 via thelnternet 15ALn ? / . ; : : . : > J . . i * e. : 

In the case 7, the basic object data stored in the CD-ROM 101 are supplied to the client terminal 13-T in- Japan for 
example via the CD-ROM drive 10©*. The update object data are supplied.ff om the shaded server terrninai (for example, 
the shared server terminal 11-1 or 11-2) specified by the client terminal 13-1. o *\: 

i In the case ,8, the basic object data are'supplied from:the CD- ROM 1 01 ; to' the^ xlient terminal ^3-i1; The;update 
75 object data are supplied from .the shared server terminal 11 B-1 in Japan specified by the friappirtg>server terrtiinal 1 2 in U 
Japan. . >" •> v^v- * : - ■ \. '-vi i : i.'j-v; \ -.*!- : ?;. ■■ ■ .r- 

. In the case 9, the basic object data are supplied from the CD-ROM 1 01 to the client terminal 1 3-2 in US. The Update i 
object data are supplied from the shared server terminal 11-2 in US specified by the mapping server terminal 12 via the?/ 
Internet 15A. - -tr i- • v - i -\ *■•: ■ , ^y- ->.^ - -r ■ . .-,.1 ■., 

20 In what follows, the software for transferring the. above-mentioned virtual reality space data to displa/the same on : 
the display device. In the WWW system, document data are transferred in a file described rn HTTv1L(Hyper TextMsirkup 
Language). Therefore, text data are registered as an HTML file. o : ; r: ^ . - c 

On the other hand*: in the; WWW system, three-dimensional' graphics data- are transferred for. userby describing frie .> 
same in VRML (Virtual Reality Modeling Language) or E-VRML (Enhanced Virtual Reality Modeling Language). There-?: ! 
25 fore, as showri in-FIG. 31 for example, a WWW server terminal t12 of remote host A 1 1 constituting the abovermen- 
tioned information server terminal ilrtAv the shared sea'er terminal 1 1B or the mapping. server terminal s 2 stores in. its 
storage device both HTML and E-VRML files. i .. f . - - *■ i. " ' i-"C i- r 

In^arvHTML file; linking between differentTiles is performed by URL: \r\ a VRML or E-VRML fHe.sueh attributes as ■> 
WWWAnchdr and^WWWInline can be specified for objects. WWWArichor-is an attribute for linking a hyper, text to an: ■ 
30 object, a file of link destination being specified by URL. WWWInline is an attribute for describing an external. view of.a. .. 
building for example in parts of external wall, roof,: window, and door for example. An URL can be related to each of the 
parts. Thus, also in VRML or E-VRML files, link can be established with other files by. means of WWWAnchor or. & 
WWWInline.n; i -zn . v-^/* ••■* *v i*. - ■> ■ -:- .. . , -i r : ' »*-.-.*v 

For application software (a WWW browser) for notifying.a WWW server terminal of a URL entered in a client termi- 
35 nal in . the WWW system to interpretand display an HTML file coming from the WWW;server terminal. Netscape Navi- 
gator (register trade name) .(hereafter; referred to simply as Netscape) of Netscape Communications, Inc; is known.; For > 
example, the client terminal 13 also uses Netscape to;user the capability for transferring idata with the WWW servefr ter- 
minal:;; m:; v;5 ; , --fri\ " '^'s .■: 00 \iy -/t>v- - s'it t ^ , ' ^ '^f -: or-; <0 
lt:§hould be.nojed, however, that this WWW: browser; can interpret an HTML file. and display the same; but tKis "-.* 
40 WWW browser icannot .interpret and :displayca VRML Q^ErVRML file, although ft can receive these files;: Thepefore, a -, % 
VRML-Browser is required which can interprets VRMkfile.and an. EfVRML^filie andidraw.and display :them as a three-:.*-, 1 
dimensional space. .7 -0* r» ■ * i\i : ■ .■ \. K'-> /\< ' or: u-n.-.'t y V 1 . f . -k : 

Details of VRML are disclosed in the Japanese translation of "VRML: Browsing & Building Cyberspace," MarK it 
Pesce,j t 1995, New ^Readers Publishing,; ISBN 1 -56205-498fB, ; the translation being entitled "Getting to Know VRML: 
45 Building : and Browsing Three^Dimensional Cyberspace^ transJated by Kouichi Matsuda, Terunao Gamaike,- Shouichi 
Takeuchi, Yasuaki Honda, Junichi Rekimoto. Masayuki Jshikawa.: Takeshi Miyashita and Kazuhiro Hara; published - 
March ?5^,1^96. Prenticehall Publishing, ISBN4-931356-37t0:; :vl ; : > , . :•: . : ' ,r . ; ■ 

^The applicant hereof- developed CyberPassage (trademark), as application software . that includes. this: VRML 
browser;- > . y'.j \j -.0 : ' ' . \r- :r* , ^-j' . ■ : i^' -y ' T" \\r. > Vi.~ *v- ' : : \ v ■ ^-Mvf. 

so CyberPassage is iComposed of the following three software programs: , ; : ;;f ; : ( * / r , * 

(1) CyberPassage Browser . *' ~> ri ■».';••■■■*■; '<r* ■ ■. :.r ^ »t »*■ * f : >-f^- 

This is a VRML browser which is based on VRML 1 .0 and prefetches the capabilities (motion and sound) of VRML . : 
55 2.(Mo l support ; E r VRML that provides moving picture capability. In addition, this provides the multi-user capability which 
can be iconnected to Cyber Passage Bureau. For the script* language; TCI7TK is used. ; . ■ 1 ^ ^ ; 
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(2) CyberPessage Conductor . • : . * ;*•'■ . v . o: ? ^ -i ' ^<v:: v^c-?" - : ^ 

This is a VRML authoring system which is based on E-VRML based on VRML, 1 .0. This, tool cap not only , .simply 
construct *a three-dimensional world but also give e behavior, a sound, and- an .image ,lo the three-dinriensional world 
with ease. i rc-.i .*■» i ' - -v -"J 

(3) CyberPassage Bureau 

This is used for a server terminal system for enabling people to meet each other in a virtual reality spf ce con- 
structed on a network, connected from the CyberPassage Browser. 

In the client terminals 13-1 and 13-2 shown fn FIG. 30 ; CyberPassage Browser, js in§t^$^in advance and ; exe- 
cuted. In the shared server terminals 11B-1 and 11B-2, CyberPassage Bureau is installed in advance and executed. 
FIG. 32 shows an example in which .CyberPassage Browser is installed; fromthe CD- ROM i 01 , and executed on the cli- 
ent terminal ;l3-3 anTi . in crcf er Ao im-l3menUhe shsred server terminal capability and the client terminal capability on 
a single terminal, CyberPassage Bureau and CyberPassage Browser are installed from the CD-ROM 101 ^advance 
and executed. 

As shown in FIG. 31 , CyberPassage Browser transfers a variety of data with Netscape as a WWW browser based : 
on NCAPI (Netscape Client Application Programming Interface) (trademark). 

Receiving an HTML file and a VRML frle or E-VRML filefrorn the WWW server terminal 1 12 via the Internet, Net- 
scape stores the received f iles in the storage device 50; Netscape processes only the HTML file. The VRML or E-VRML 
file is processed by CyberPassage Browser. 

E-VRML is an enhancement of VRML 1.0 by providing behavior and multimedia (sound and moving, picture) and 
was proposed to the VRML Community, September 1995, as the first achievement of the applicant hereof, the basic 
model (evsnt model) fcr describing motions as used jn E-VRML is inherited I to the Moving Worlds ^ praposa!, . one the cur- 
rent VRML 2.0 proposals. v 

In what follows, CyberPassage Browser will be outlined. A sample of this browser is provided in the CD-ROM fur- 
nished to the Japanese translation of "VRML: Browsing & Building Cyberspace," Mark Pesce. 1 995 ; New Readers Pub- 
lishing. After installing this browser, selecting "Manual" from "CyberPassage Folder" of "Program" of the start menu of 
Windows 95 (trademark); (or in Windows NT (trademark), ths Program Manager) displays the instruction manual ; of the 
browser -J ; ; t v<\- : " . : '. . •*:.•.-• : *- • • - > -« • ^ ■/ } ^ ■■ -\l . : ' = -■;: -= 

Operating environment of CyberPassage Browser: 

The operating environment of CyberPassage Browser is as shown in FIG. 33. The minimum operating environment 
must be at Jeast satisfied. However, Netscape Navigator need not be us;ed if CyberPassage Browser is used as ; e stan- 
dalone VRML browser. In particular, on using in the multi-user, it is desirable the recommended operating environment. 

Installing CyberPassage Browser: :H ; e 

CyberPassage Browser can be usually installed in the same way as Netscape is installed. To.be more specific, 
vscplb3a.exe placed in the \Sony (trademark) directory of the furnished CD-ROM is used as follows for installation. 

(1) Double-click vscplb3a.exe. The installation package is decompressed into the directory indicated by "Unzip To 
Directory" column. The destination directory may be changed as required. v :; -;.>r, O 

(2) Click "Unzip" button. And the installation package is decompressed. 

(3) "12 fil&s;unzipped succes^fwilyr appears. Clid: rt OK" button... , < ^. . : - v ;i : ' 

(4) When "Welcome" window appeared, click "NEXT" button. 

(5) Carefully read "Software License Agreement". If agreed, press "Yes" button; if not, press ?Nq? button, 

(6) Check the directory of installation. Default is "Program Files Sony\CyberPassage", : , , . 

(7) If use of the above-mentioned directory is not wanted, press "Browse" button and select another directory.Then, 
press "Next" button. ... 

(8) To read "readme" file here, click "Yes" button. 

(9) When the installation has been completed, click "OK" button. 

Staiiir*g CyberPassage Browser: v :' .» * : . r *:c > ; „.•• s r, - > .-.^ v r ; 1 1 

Before starting CyberPassage Browser, setting of Netscape Navigator must be performed. If CyberPassage 
Browser is used standalone, this setting need not be performed; just select "CyberPassage, polder-.,. CyberPassage" 
of "Program" of the start menu and start. The following setting may be automatically performed at installation. 
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(1) From "Options" menu of Netscape Navigator, execute "General Preference" and open "Preference" window- 
From the upper tab. select "Helper Applications". 

(2) Check "Fiie type" column for "x-world/x-vrml". If it is found, go to <4) below." 'C< - ~ • •* ; " 

(3) Click "Create New Type" button. Enter ^x-woi ld" in "Mime Type" column and "x-vrml" en "Mime SubType" column.. 
Click "OK" button. Enter "wrl" in "Extensions" column. 

(4) Click "Launch the Application:" button. Enter the path name of CyberPassage Browser in the text column below 
this button. Default is '.*♦.,'...' * 
"VProgram Files\Sony\CyberPassage\bin\vscp.exe". 

(5) Click-"OK" ; bimon. ' - ' - ! <* * : ' ' ' ■ ^ : - ^ ' 

Thus, the setting of Netscape Navigator has been completed. Start CyberPassage Browser as follows: 

(1)1n "File. O^ ' l ' 

"(2) Click the link to the r sample WoTId, : ^iid "CyberPassage is automatically started, loading the sample World from 
15 -theCD-ROM/ ; ' -""< : ; ■ " ' > '• ■■ ' v *:<:.*■=■.: - C. — , 

Uninstalling CyberPassage Browser: n - — - :^v . :j , '< ■ : i -^ 

Execute "Uninstall" from "CyberPassage Folder" 6f "Program" of the start menu (or in Windows NT, the Program 
20 Manager), and CyberPassage Browser will be uninstalled automatically, ■ . ^. 

Operating CyberPassage Browser: -tv. ,■• ■ . 1( .w ; n ..v ? / - .j... ' ." 

CyberPassage Browser rhaybe operated intiiitively with the mouse -49b, the keyboard 49a, and the buttons; on . 
25 screen. ^ V :. 0.- J. ' h T-; « 

Moving around in the ! thfee<limensiohal , space:'-r ' 1 ■'- " ^ • ' - 

In the th'ree^mnensibnal space provided by VRMli, such movements done in real world as forward, backward, 
30 rotate right and rotate left for example can be done. CyberPassage Browser implements such movements through the 
following interface: 

By keyboard: 

35 * Each of the arrow keys, hot shown, on the keyboard 49a generates the following corresponding movement: - • 
rotate right; 

<- rotate left; ; . J .v ; ?/;V^ . c -f 

T move forward; and 

40 1 v J; move backward/ r - : { 1 - ; - n u&'ca**,. x ',\^\. . y- * v y;» 

. . ?- : f ; w .. ■'. • "■ ;-"»■ :. \ : V- -C* m .tB- r ./.* : n ;.*■.> v ;f.. ' ;i ?■ * ■ v v' >r ' i-i- . r\ 

By mouse: 
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Operate the mouse all with its left button. .«;.*..-'.=,:.!■. ^ * ■ ; - " f r r ; v 

(1) Keep the left button of the mouse 49b pressed in-1he window of CyberPassage and move the mouse: 



to the riight for rotate 1 right; 1 ' --i t : - r > ' * ^ \: . ; ; :r 

to the left for rotate left; : - j ; \ , ; < . v ' j ■: : i* , i. : : 

so 'up for forward 1 ; arid " •: '* - ' - r * - • ' vr-.-v \ w:- r <-r: )c ? ; 

down for backward. ! ". • c-: 

The velocity of movement depends on the displacement of the mouse. 
55 (2) With the Ctrl (Control) key, not shown, on the keyboard 49a. kept pressed, click an objection screen to.get to 
the front of the clicked object. 

The following precautions are required: - v ^ ^. v . : . > * • ^ i iV.- ..^ j ^ -v*.v, 
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If a collision with an object occurs, a collision sound is generated and the frame of .the sCT^Qn,.^in : K5^.iEri_ rf»4 : ff |f -t|iis r 
happens, any forward movement is blocked. Moving directions must be changed. 

If the user is lost or cannot see anything in the space, click "Hpme" button on the right of screen, and trie user can 
return ; tothe:homaposition^ J( -,- c , . . * Yrii * r ;• { ,, , • \; ^ ■ . : <~*i r^cv : 

Jumping- eye: , rr . v - r-'- .• ■ : -ij,- ' 7 V. . v <i > - ..?<-■.-*--•; --/^y • • ."r.iF* 

While navigating through a three-dimensional space, the user may be lost at occasions, jf thi? happens, the user 
can jump up to have an overhead view around. 

(1) Click "Jump" button on the right of screen, and.the user enters the jumping eye mod? end jumps to a position 
from which the user can look down the world.: ;y -i^ij^-c ' /) : .v ^: : :; ; / v ; o . -^r 

(2) Click "Jump" button, again ? . and tti%usef ; gpes .down to-^e.prigjnal.jx^flon^ f : r v - 0: . ^ 7 . lb ; ~ , 

(3) Alternatively, click any place in the world, and the user gets down to the clicked position. 

Selecting an object: 

When the mouse cursor is moved around on the screen, the shape of the cursor is transformed into a grabber 
(hand) on an object* In this state, click the left button of th^ mouse, and the action of the grabbed obj^t can be called. 

Loading a VRML file: . b -r^Z v-v 

A VRML file can be loaded as follows: •, ^n*-, . /v " 

In Netscape, click the fink to the VRML file; : <v ^ _ • ^ v,, . : t . : y; } \k: -,g *. 

Rom "File Open File" menu of CyberPassage, select the file haying extension "wrl" on disc. - .. ,< -y t , t .. ^ 
In "File..Open URL" menu of CyberPassage, enter the URL 

Click the object in the virtual space for which "URL" is displayed on the mouse cursor. : ., , . v , ; 

Operating toolbar buttons: $ - * r ; ; ^ :J ^ ry ■ , lV s ; i ; r!lu> r?: 

Buttons in the toolbar shown in FIG. 37 for example may be used to execute frequently used functions. 
"Back" Go back to the world read last. 

"Forward" m Go to the wprkJ after going back to the previous world. . - . . ■ ... ; - ^ ^\ 

"Home" s: * Move to the home position.* t. . rt ^ r y. : 1 ^ .v.,xk* ;<,-;> c 

"Undo" Return a moved objec! :tp the original position (to ^ described later). , ; • r-. 

"Bookmark" Attach a bookmark to the current world or position. 

"Scouter" Enter in the scouter mode (to be described later). ;y;^ , V r : ( 

"Jump" Enter in the jump eye mode. 

Scouter mode: ; * ^ . :n - > . - Vv* i nr; 

Each object placed in a virtual world may have a character string as information by using the E-yRML capability, 

(1) Click ■ Scouter" button on the right of screen - . ^ ' 

(2) Wherrthe mouse cursor movesonto an object havingan inforrration label, the information la^ is displayed.. 

(3) Click "Scouter" button again, and the user, exits the;S<^uter mode. ^ ,.r - r 1 r 

Moving an object around: ■• , < •. u ;v • • -'-.v - , v**.^'. ;y ;.. 'r*\ . V J . ,> ' ■ -^ : oo '-t 

With -it" (Alternate) key, not shown, on .the.keyboard 49a pressed^ press the left button of .the mouse 4Sto on : .a 
desired object,; and the user.can mpve thafcobject to a desired [position with the mouse This is like moving a coffee cup^ 
for example on a desk with the hand in the real world. In : the yirtuaj reality,, however. objects ; thatcan be moved are thc^e 
having movable attributes.- ln the sample world, objects may be -moved by. Digital HandyCarn and the like. It should be 
noted that a moved object may be restored to the position before movement only pnce, by using "Undo": button,^ lT 
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Connecting' to - y ' J: . : ;* ? • >v ■ 

CyberPassiage Browser provides a multi-user capability. The multi-user capability allows the shying of a same 
VRML virtual space among a plurality of users. Currently, the applicant hereof is operating CyberPassage Bureau in the' 
5 Internet on an experimental basis. By loading "Chat Room", the server terminal can be connected to share a same 
VRML virtual space with other users, walking together, turning off a room light, having a chat, and doing other activities' 
for example. 

f his capability is started as follows: * : ,Xi ' . 

10 (1) Make sure that the user's personal computer is linked to the Internet. 

'(2) Load the' "GKdtr&oiri" or the sample world into CyberPassage : Bsowser. This' is done' by loading 

"\Sony\readme.htm" from the sample CD-ROM clicking "Chat Room". ' > r ^ ■ r?, r r 

(3) Appearance of "Connected to VS Serverln' the message windfiw^iridicates successful connection.- * : - J ' ' 

is Thus, the connection to the server has been completed. Interaction with other users is of the following two types: 

(a) Notifying others of an action: 

This is implemented by clicking any of "Hello", "Smile H , "Wad!" "Wood!!"! "Umm...", "SadT. "Bye" and so on in the' 
20 "Action" window (refer to FIG. 39). The actions include rotating the user himself (avatar) right or left 36 degrees, 180 
degrees or 360 degrees. . : •;•.»: . ■ ■' r :. r -i 

(b) Talking with others: v - - : - ' ' ' * ?z -■: ■ .>V"*. -.■ A 

25 This capability is implemented by opening the "Chat" window (refer to FIG. 39) in "View . Chat" menu and entering 
a message from the keyboard 49a into the bottom input column. - : " ^ '* 1 *; ^ cv; 

r; " t % ? ,.'5 ,.• ■ > ";. ■ *r, : :* j : * „ i'J° 'r-. 4 A 

Multi-user worlds: - c -* ' : !: '* * : " - • . '^O 

30 The following three multi-user worlds are provided by the sample CD-ROM. It should be noted that a chat can-be- 4 
made throughout these three worlds commonly. 

(1) Chat Room 

35 This is a room in which chat is made mainly. Some ! objects in this -room are shared among multiple users. There * 
are objects which are made gradually transparent every time the left button of the mouse is pressed, used to turn off 
room lights, and hop up when clicked, by way of example. Also, there are hidden holes arid the like: - 

(2) Play with a ball!! : ; . - - j\ ^ - kv. 1 - 
40 ? f.- \: -~ -■ ' ! • z 

When a ball in the air is clicked, the ball flies toward the user who clicked the ball. This ball is shared by all users 
sharing that space to play catch. 

(3) Share your drawing vl : l - - ;i fi '- - ? « " ' / . ■ v * : : 5 • ' 

45 

A whiteboard is placed in the virtual space. When it is clicked by the left button, the shared whiteboard is displayed. 
Dragging With the left button draws a shape on the whiteboard, the result being shared by the users sharing the space. 

In addition to CyberPassage Browser, the sample CD-ROM stores CyberPassage Conductor and some sample 
VRML files. CyberPassage Bureau is not stored in this CD-ROM, however, tt can be downloaded via the Internet 15A 
so from Home Page U RL=http://vs. sony.co.jp/ provided by the company at which the applicant hereof works. The company 
also offers, via the Internet the multi -user world URL= http://japan.park.org/japarVSony/3DWorld/Circus/. 

U6e of CyberPassage Bureau allows the users using CyberPassage Browser to enter together a world described 
in VRML 1 .0. To provide a' three-dimensional virtual reality spate for enabling this capability, a file described in VRML 
1 .0 must be prepared. Then! CyberPassage Bureau (hereinafter appropriately referred to simply as the bureati)1s oper- 
55 ated on an appropriate personal computer. Further, a line telling the personal computer on which Bureau is operating- 
is added to the VRML 1.0 file. The resultant VRML? file is read into CyberPassage Browser {hereinafter appropriately 
referred to simply as the browser), the browser is connected to the bureau. 

If this connection is successful, the users in the virtual world can see each other and talk each other. Further, writ- 
ing an appropriate script into the file allows each user to express emotions through a use of action panel. 
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CyberPassage Browser provides interface for action description through use of TCL. This interface , a)i^v ;: cachr 
user to provide behaviors to objects in the virtual world and, if desired, make the resultant objects synchronize between 
browsers. Jhisallows a plurality tp plav a threejdimensional garne if means^to ■ - : 

To enjoy a multi-user virtual world; three stras arer^uired; preparation of a V file.,. starts CyberPassage - 
Bureau, and .connection of CyberPassage Browser.. : : . : - ■•' ~- ^- > ; m . r s'c-i- i 

Preparing a VRML file: :^ . : j;;r;;v:^ . :c.r : 

First; a desired VRML. 1.G file must be prepared. This file is created: by oneself or a so-called fr ; £s\yare is«used;far 
this file. This file, presets a multi-user virtual world/ > r ; / >.c ; C /Iw-^oV c; 1 K*r v v ; ? ^ o = . ^ 

Starting rGybsrRassage Bureau:., j.v, v » >\v.- - r o *-.r .3^:^ " -wpt^ voo.no^c'" 

The operating environment of CyberPassage Bureau is as follows: t r .:; s : i r . r / , 

CPU . ... 486SX or higher i ; . ^ . " k-' /< V v,-^- " m.*.-* -v : ""^ ^ : >*r : -: -i 

OS r Window 95 ;. ' - - " : ,. ■ " ... • .•• " >-<:3 " < " " ; • " - ; ^ '.: 

Memory ... 12M or higher . > ; : \- ' •'> ' • !::> ;"' : ' v '■ 

CyberPassage Bureau can be started only by executing the downloaded file: When this CyberPassage Bureau is 
executechonly a mem? bar indicating menus is displayed as shown in FIQ.34. Just aftor starting; CyberPassage Bureau : . 
is in stopped state Selecting "status" by pulling down "Viev/Vmenu displays the status window that indicates the current 
CyberPassage Bureau state. At the same time, a port number waiting for connection is also shown^ . t v sc;-- 

Immediately after starting, CyberPassage Bureau is set sudUhat it waits for connection at ,TGR port ;Nca51 26. :lo 
chang6<this r po^<numtoer lt pull down "options" ;menu and select "port". .When entry of a new f por.t riumbev is prompted, 
enters port number 5000 or higher. If the user does not know which port number to enter, default valua : (5126) can be 
used.,- f.'b* v ' . :• * ' r . . . .-/""J ■ t ' , *.T \ .J' • • .^■■-■'^ " r ^ 

To start CyberPassage Bureau.from the stopped state, pull down "run" menu.arrf select "start". The server terminal 
comes to ; be connected at the specified port. At this moment, the state shown in>"status" windo>v becomes ."running" as 
shown in FIG: 34-: . ;: . ; , - vc^v^.^i;- ■ v~ • Kr,:A : •'• ^>°'-^~. 

Thus = after completion of the bureau preparations, when, CyberPassage Browser, comes to connect to CyberPas- . 
sage Bureau, it tells the position of the browser to another ;browser or/iransfers information such as* conversation and - ( 
behavior. ■ sr..:t-\ . \: 1 • . - . A .-^ .--i :.:''?sA c * ^ ^ ' v ?b?rten* i .« ' : >* * -V ; 'y. j-a 

The ^status" window of ,C>t>erPassage Bureau is ^pdated ; every time connection is made by^the.user, so that using 
this windov-f allows: the user to make sure of 1he users.existing in-thatvirtuahworld * j . o 'vn ,e ' ^ ( h^: \v 

Connexion cf .CyberPassage Browser: ; - ^; - t \ Brr ! -' ? r..r.^- ^'v^.r w-.i? c-r- i^-OJ" ^-^r-iy: 

Connection of the CyberPassage Browser requires the:^o!?owing twcrStepsv.First, instruct CyberPassage Browser 
to whicb bureau it is to be connected. This is done by writing ;ari:"inlb.^h^e;to-thp;VBMLif ile. Second, copy: th^ user s 
avatar fi!e to an appropriate direction so that ^the user.can be seen fronnrthe other tisers.= v^ ; v - c : ■ ,* ^ 

Adding to a VRML file: ^ : ! -i ' ^ 

AA/hen writing a line specifying the bureau to be connected to tht, VR^L ':le, a name of the personal .computer-. on 
which the bureau is operating and the port number imist be specified;in th« following formal c ■■: 1 ; v - 

i\ DEFVsSen-er Into {string"S8rver name:poi*t number"}:/ . * v . - , ; - rri:^ 

The &erver terminal name :s a n>achine name as used i.-i tie internet on which the bureau is operating (for example, 
f red; research.sony.com) or its IP address (for example,^ 23.231 .12.1). The port number is one set in tlie bureau. ^ j 
Consequently, the above-mentioned format becomes as fellows for. example:; { J' i.Nv ' ^ U 

DEF VsServer lnfo^string n fred.research;sonycom:5126"} tv ■ ^ f " - Oi -Mi-- c . : » " 

in *:ieiexample of FIG '32, the IP addriess of the shared server.ter minal 1 1 -1 is 43.0.35. 1 1 7, so that the above-men- 
tioned format becomes as follows: 'V- '= • :V^ >, : * ' - ? ^ ^ . . 
DEFVsServer. Info {string"43.0:35: 11 7:51 26'1 ' : ; 'v ^ '•' ^ ■» * '■ ' ^ - - • ■■' 1 
This; is added below the line shown below of the prepared VRML file:. „ ^ : ' - - , j -; - 
VRML V1.0 ascii : " : v " ;r - : - . ;.-.v-v.:r r v *o - -ryi 
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Copying aTY*Sifi»"fife: ^ ! ^ J ' T ~10'\ •-' ^ *' . .^v<^-':;. , A ... • ■;■ v : ->vq ;:r.v,-o\~ *. . • 

.>.^ *.'?.; J er'r.ori^^v'. ^rci:-. J -i^u?^" • ■ *v: '■ ' : » r, ; y . a i\j^[:io o l - . J,;,\<j - ■ e 

When CyberPassage Browser gets connected to CyberPassage Bureau; the former notifies trie letter of ite Water ■ 
When a'Sp^i&ava^^ meets another, the bureau notifies the other^browseis of^ to make foe 

s specific avatar be displayed on the other browsers. For this reason, it isTequirec to copy ths.VRML file of the specific tj 
avatar to an appropriate place in advance. 

FIG. 34 shows an example of display for selecting an avatar. In this example, a desired avatar can be selected as 
own avatar from "person.wri", "boy.wrl" or "girl.wrl". 

Wltert thfd selected 'avatar file copied ! to the same 'directory in which own VRML file is siored, the browser 

io searches the directory for the "{person,boy,girl}. wrr file as the avatar file when 1 thebrowser loads the VRML f ile. i ■£ ' : 
Thus, to share a specific VRML file. CyberPassage Bureau may only be operated, the VsServer Info node be added 
to the VRML fae, and "{person.boy.girl}wrr be copied to the same file in which the VRML file is stored. Then, when the 
VRML file is set up such that the same can be loaded from other users, any user who reads the file through CyberPas- 
sage gets connected to the bureau, .^w 1 *\ -n.'-r-*;- S :s : ^: ; vC '-.■> Jr.* - q > "-■ ■ 

75 As shown in FIG. 32, it is assumed that the shared server terminal 1 1 B-1 uses an avatar nicknamed Koutarou and 
the client terminal 1 3-1 uses an avatar nicknamed Minami to walk through one of the multi-user worlds, CIRGUS PARK. 
In doing so, the shared server terminal 11 B-1 selects a male avatar "boy.wrl" as shown in FIG. ; 34> for example. As t 
shown in FIG. 35, when "View" menu is pulled down and "Preferences" is selected, a screen asishown in FIG. 36 is 
displayed. On this screen, the user specifies "Koutarou" as the name (Nick Name) of the avatar selected in FIG. 34. 

20 Likewise, the user of the client terminal 13-1 selects "girl. wrr* as own avatar for example, specifies ^Minami" as its 
nickname; 1 and 'enters CIRCUS PARK: When avatar K&utarou of the shared server terminal 1 1B-1 'and avatar Minami 
of the cltenf lerthiri&i -13-1 moveto positions close enough to each other, &vat&r Miriami is displayed oh the^diSplay" 
device 25 of the shared-server terminal- 1 4B-1 as shown in FIG. 35: Likewise, avatar Koutarou isdisplayed on the dis- 
play devicfe 45 of ithe: client terminal 1 a- 1 as Shown in'FIG. 38 to be described later. 1 ..~~r* , v:3 

25 1t:shdulGtbe rt&fed that, in FIGS. 32\ahd<34 through 37, "K" is assigned to the display screen of the display device * 
25 that avatar Koutar6u Sees and "M" is assigned 1o the display screen of the displa/idevice 45 that a^/dtar Minami sees; v 
As shown in the figures, each display device displays only the three-dimensional virtual reality space (including the 5 
image of the other avsitar) as viewed from- own avatar, and own avatar- itsetf is not displayed. - ; ^ ^ : -> ' : oV 
r Thusi when a plurality of avatars approach eachcrtherctose^enough in a specific space (namely/ whert-own avatar 

30 is displayed on the display device of the other user's display device), a chat can be performed by selecting "Chat" from" 
"View" menu~showh in FIG. 37 for example. ^FIG. 37 sHow&;an example of display on the display device 25 of the shared 
server terminal 11B-1^hen avatars Koutafou and1v1fnami are^h^ing achat, : _ » -i.- - 

As shown in FIG. 37, the messages entered so far from the keyboards of the terminals concerned are shown in the 
"Chat" window. Characters entered by the userare once displayed in the display area at the bottom of the "Chat" wih- 

35 dow; when the Enter key, not shown, of the keVbdartf 49a i stressed, the entered message (character string) is trans- 
mitted to the other user. For example, when message "Yes, it's my first visit today" has come from avatar Minami (the 
client terminal 13-1) to the shared server terminal 1 1B-1 , this message is displayed* in a balloon above avatar Minami. . 
in the CyberPassage Bureau window on the display device 25 of the shared server terminal 1 1 B-1 and, at the same 
time; displayed in-the '"^^ >-:svr k-:v.v : •; ■ :.. ■■ 

40 -FIG; '38 shows an* Bxamp1^;of display on, the display device^otirre client tarhinalr.l 3^1. when message "Lel'^jgdw 
see the merry-go-round" has been entered from thersh&redserVer terminal- 11 B-1 . trr thiscase; too; themessage is ; disr 
played in a balloon above avatar Koutarou in the "CIRCUS PARK" window and, at the same time, displayed in the "Chat" 
window after the past messages. t V c . . . U 

An example of display of FIG. 39 shows the case in which "Hello" button has been pressed on the client terminal 

45 1 3-1 . At this timei as shown in FIG. . 39, an image ih-Which avatar Minami raises its right hand is displayed on the shared 
server terminal 1 1 B-1 and, at the same time; voice message "Heliosis heard from the 'speaker 27> :, . ' * . i w- 

When the user leaves his terminal, his avatar may be put in the sleep state. For example; to put avatar^Miriarhi in 
the sleep state,* "Active" button,- one of the action buttons in the action windows shown Jn FIG.-38, is clicked bn the.clieht 
terminal 13-1 to change the shape of this button to "Sie'ep" button as shown in FIG. 40 /Avatar Minami enters the sleep; 

so state. In the sleep state, avatar Minami displayed 'on the displayed device 25 of the shared server terminal 1 1 B-1 is sit- 
ting on the ground as shown in FIG. 41 . The user of the shared server terminal .1 1 B-1 ;can know from this state (namely, 
the user avatar Minami has left the client terminal 13-1} that avatar Minami is in thie sl^ep state.'Whenv'Sleep" button is 
clicked in the sleep state, the button returns to "Active" button again. a \ ? * .'• -*ro; ;.y*" 

Thus, the users can enjoy themselves walking through the Circus ;.Park as a threeiKJirfiensional virtual reality space. 

55 The present invention is applied to embody the. : parade, the moveimerrt of avatars ; and avatar 1 behaviors bytthe 
action window buttons implemented in the above-mentioned Circus Park. : t - - 0 . . ' . 

The present invention has been described by taking for example the case in which the Internet is used for the net- 
work 15 and the WWW system is used. It will be apparent to those skilled in the art that a global communications net- 
work other than the Internet may be used for the network 15 and a communications system other than the WWW 



25 : : 



EP C7J53 835A2 



system may be used to achieve the above-mentioned objects of the invention. : ; r : ; >, v :;or rr - r 

As described above, acc to the present invention, in thetriree dimensional virtual re^.sharing method, the 
system, the information recording medium, the information recording method. ; the.informaton,fransrrissiqn medium, 
and the information transmission method, the change sequence of the plurality of sub objects corresponding to the 
updated consent of the state oMhe update object is stcredjn each client terming ^ arKJ.the changes,s^uences on the 
plurality of client terminals are stated in rynchrpnization^Tha above-mentioned novel setup ailqws the behaviors of an 
object having a complex shape composed of a piuralitf of sub objects to be ;cha^ 

tual reality space on the plurality of client terminals, thereby significantly enhancing the display speed of images. 

Further-according to the presen* invention, in.the ir^rmation processing; method, the client terminal, ♦he.ipforma- 
tion recording medium, the information recording methc^ 

transmission method, the change sequence of the plurality of sub objects corresponding to the update content of the 
state of the update object is stored in a client terminal and started in synchronization ^thjthp r^ano? ^ sequences stored 
in other client terminals. The above-mentioned novel setup implements a client terminal that can snare the same three- 
dimensions:! virtual reaHty space w : f_ l : : ^ >-m;t-i'; -^i!:;^.:^- Jc;^ 

Further, according to the present invention, in; the information, processing methpd. the^eryer terminal,,Jhe. informa- 
tion recording medium, the information recording method, the information trarismiss^ medium, .and the information 
transmission method, if a message indicating update of the state of the update object is entered from^a specific client 
terminal via the global communication network, this message is transmitted to other client terminals via foeglqbal com- 
munication network and; in.synchronization : with the change sequence of the plurality of sub objecte. in^the specific, client 
terminal the change sequences of the plurality of syb objects in the.othercye^t^rmi^ abpve-men- 
tioned novel setup allows implements a.server terminal that can proyide^the same^ree-dimensiona! Afirtuahreality 
space to the plurality of client terminals. ^ \: > ^ a 

While the preferred embodiments of the present invention have been described using specific terms, such descrip- 
tion is for illu strative purposes only and it is to be understood that changes and variations may be.made ; withp^t depart- 
ing from the. spirit or scope of the appended claims. ^ .j ; ; ~ , ' rh ; vr : ;y ^ i n ;: i ^ v ^ 

Claims o : : . \j .r ■'*■;" . .* : c-- n :r - ' : - - ' ; - lt < f :; ' * v 

1 . A method fo sharing a three-dimensional virtual reality space comprising the steps of: 

connecting a plurality of client terminals (13-1. 13-2, 1.3£) for displaying^ three-dimensional virtual reality 
space including an update object constituted by a plurality of sub objects each of which state is subject to 

•x. change to a shared server terminal (1 1 r1 ,1 1 -2) ^for. controlling a state of thejjpdate object on each pf.the plu- 
Fality of dtont terminals via -a communication network (15).;oi-i..?. y&'f~- -.h ^b-j?-- c 

. registering in eSch of the plurality of client terminals in advance a change sequence stable, for d^injpg a rela- 
tionship between a sequence of changing the state of each of the plurality.©! sub objects according to, a change 
to Hie stated the update object; and a message fonspecrfyirsg a t^ 

i-\ iwhen the state of the update object controlled ;by. the shared server terminal is updated, notifying each; of the 
plurality of client terminals of the message corresponding foiiipdatki .content- ot the state of the update object 
from the shared server terminal; and i-vr-* ;>r<-: i c vc ^o*;- > - ; • ? a**- :■- ^\ <:■ 

• ; changing on each of .the plurality of client terminals-^ 3-1:, l3 r 2, : l3-3) the state of each of the plurality of sub 
objects based on the change sequence specified by the^message to reflect ttip, -otrcng? in the displayed three- 
. dimensional virtual reaiity spaced : it; r^:> • ; ; : ; •> - :> ' : o; 

2. The method of sharing a three-dimensional virtual reality space according to claim 1 , wherein each of the plurality 
of client terminals (13-1, 13-2, 13-3), if the state of the update object is updated according to an operation per- 
formed by auser of each o? ths plurality, of client terminals, notifiesthe shared server termina! of the message cor- 
responding to the updated content. ^> : : ' ' " y • ; : 

3. The method of shar ing a th;eerdimensionar virtual reality space according to claim 1 , wherein ifce updated content . 
of the state of the;update object is a behavior including displacement and rotation. ( . • v . . . _ ( . : - fl/: ..- 

4. The method of sharing a three<Jimensionah virtual reality, space according to claim 1„ wherein the . change 
sequencers a procedure of composite cooperative operations of the plurality of sub objects. - 

5. The method of sharing a three-dimensional virtual reality space according , to claim .-V wherein the change 
sequence includes at leastone of a direction of displacement; a velocity of displacement, a period of displacement 
iind a distance is displacement, and a direction of rotation, a velocity of rotation, a period of rotation arid a distance 
of rotation, of each cf the plurality of sub objects. J. . :^ ». v. -.v '.-■•-j -*r-. :v w; ' s 
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6. The method of sharing a three-dimensional virtual reality" space according to claim 1 < wherein <lhe shared server .: t ^ 
t^TTiinai l ( i1^v 14 -2) Cities each;6Y^ plurality of client terminals (;13-1 , 13-2; 13-3H* thre message correspond* 
ingfotrteU^ ^; f :> j, rwn;^ 

5 7. the method of ^Raring ^a three-dimehsional virtual reafity spacfe according to claim 1 , ^wherein the communication * j 
network liBri^^ 1 1))^ message betw&efrunspecifi^'^ terminals and the shared serveMermin&l; : u\r 

bas'^onVcq^^ protocol cafflM^ Protocol/Internet Protocol); '£ ' y ' 

8. the method of ^h&ohg a three<iimerisibrtel-vi^ Space-according to claim 1 , wherein three-dimensional 
w ^rapfiicsdata W the Update object is written in^VRML (Virtual Reality Modeling Language) . ^ 

9. AsySternWshar^ ' fr * : sn, • v ; 

a plurality of client terminals (13-1 , 13-2, 13-3) for displaying a three-dimensional virtual Jrealfty space including : 
is ' an update object constituted by a plurality of sub objects ieach of'wW ^ v 

' ' -a 'shared ieirver terminal forcontrolling'a state of the update object on eacrvof the plurality of client terminals; ?: * 

a^oitimunicatiori netwbrk^TS) for connecting each of the plurality of client terminals to the shared server .-.ten-* >-<... 
~ ; minal; and ,i V ' : ■ ■ ~- ■ - ^ ■ : - ■ - • - • ? ^ »■* . . ■ j s * -v;. - 

a change sequence table for defining a 1 relationship between a change sequence of the state of each of the sub 
20 ■ 'objects corresponding to update cohtent of the Sfete of the update object and a 'message for specifying a type ~. 

< ' df 'the change sequence, the*charige sequence table being registered in each of the plurality of dient terminals; i - 
in advance; - ~» ' .>*■ ! * 

- * * 1 ! 'whereinF^rieh'the state' of the update object' control! 3d by the shared server terminal is updatedrthe shared 

25 server terminal notifies each of the plurality of client terminals of thermessage corresponding to updated content of u I 
the state of the update object, and 

each of the client terminals changes the state of each of the plurality of sub objects based on the change^: 
sequence specified by the message to reflect the change in the displayed three-dimensional virtual reality space. 

'■' " ~' ■■*• *V' >j '• - -v- <; - v -■ -1 - :> 

30 10. An information recording medium for use in a three-dimensional virtual reality space sharing system to record a 
''computer program corhprising the processing steps of : • • . r ■ f 

o'. ,:-:ur. e : •;• "s\ ; f ^i::v. j, rt.'V*, ; J- . -'vo • r. t ; : ..:. . ' * _ ' ■* :/"'-n ■-.r • ' ■ 

- 1 : corihectihg r a plurality of client- terminals (13^3/ 13^2, 13-3) for displaying a three-dimensional virtual reality 
space including an update object constituted by a plurality r of sub objects each of which state is subject to 
35 1 bhahge^fo a shared 'serveff terrhinal for coritrolfing a sftate of the update object on each of the plurality of client 

ierfrfinal^^via -a-corhifiu'ra<^ibh j ili^brK^ r -- r '? ' x -~ % ' ^ ^ : v "■ X ■ : ' s - * ^ c i • ■ / . 

registering in' each of the (Aufaifty of cliefrtaerrrirnate in advance a changfe sequence<table for defining a rela- 
ii.t '-tjorahip bietween a sequence of changing th^state ofiEtachbt th0pluralEtyof sub objects according to a change 
iO ^cjcto^hiB^state brthe update object and a- messafge ^ for specifying a type of the change sequence;. . . v s ! j 
40 when the state of the update object controlled by the shared server termihal (1/1 -1 v t l -2)iis updated, notifying 

' each of the'0lurality of cliefrt^tefminals of thfe rheasag'e corresponding to updated content of the state of the 
^update object ffom the shared server tCTrninai;vand- i'- :^r-~ ■ :■ :« ■ ^ c-*o . ^ j ^ :o 

changing on each of the plurality of client terminals the state of each of the pluralityd sub objects based on 
the change sequence specified by the message to reflect the change in the displayed three-dimensional virtual 
45 reality space; 1 ! — 1 ' " : - ; ^ ^ 'V-'h'^. *; . *trir,ri ' . *- VT > 

; - *H wherein the corriputer program is readable and executable by at least one of the terminals consisting^of the 
shared server terminal and the plurality of client terminals. .i j b: =. < , ?i / c ^-c . ; i 

50 11 i /f An ihforrhatibh recording method for use in a three^dimensionali virtual reality sharing system to record a computer r 
program in an information recording medium;! the computer program comprising the processing steps of : t; 7 f c 

v J connecting a plurality of client terminals (13-3, 13^2, 13^3) for displaying a three-dimensional virtual -reality * 
space including an update object constituted by a plurality of sub objects each : of which state is subject to 
55 change to a shared server terminal for controlling a state of the update object on each of the plurality of client 

- terminals via a communication network; &>r '■: l ' .ik. r : r-.r. . U : . r^ -r.r <T ? 
» registering in each 6f ; the plurality of clierit terminals in advance a change sequence table for defining;a rela- 

*- J tibnship between ^sequence of changingithe state of each of the plurality of sub objects according.to a ohange 
to the state of the update object and a message for specifying ^ type of the.change sequehce; ' . ; - v 
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-fc.^whemtbe state .of. the update object controlled by the shared server terrninaljis upd3tediinot^:ing:eac;:-of the 
ply rality.of client termirais (13-m3-2, 13-3) of the message corresponding to updated content oi,the state of 
the update cfc-cct fr$m..me.shared.serv8r terminal; and •:>$■■ ■ : s^m r s:^ ■ ■ * ■ 

r r -changing on-each of the plurality of clienvterminais^^^^^ based on 

;; the change sequence specified by the message; to reflect thadiangainithedispta virtual 
reality space; ^ = • ^ -,v 

wherein the computer ; program is readable aixi exec* Jtabie by at lea^ one of -the terminals consisting of the 
shared server terminal (11-1. 11-2) and the plurality of client terminals (13-1, 13-2, 13-3). 

12. An information transmission medium for use in a three-dimeneiona! virtual realfty^spaee^haring system to transmit 
a compute^ program comprising theprocessing steps of: t ?r o o-v^d j.i a. etsJ? rfo«tw v. «; : > ; 

connecting a plurality of client terminals (13-1, 13-2, 13-3) for displaying a three<limensional virtual reaiity 
space including an update object constituted by a plurality of sub objects each of which state is subject to 
x change to # shared server terminal (1 1-1, 11-2) for control ling a state of the update object on each ofrthe plu- 
k -rality of client terminals^ 3-1, 13-?. 13-3) viaacommunication network (15); ^ *- : j^., " : ■ ? 

r registering in each -cf, the plurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according lo a change 
r to the state of the update object and a message for specifying a type of the change sequence; ; - >~ ' 
when the etate of the update object controlled by the shared, server terminal is updated, notifying each of the 
plurality of client terminals of the message corresponding to updated content of the state oithe:updatO object 
from the sh = red server terminal; arri ; ; t\\ . " ~0 »;r. -v :: r> : ' ',"•!; ,.':;.;i- : -v r-^:^.',. 1 ';:;^ 
changing on each of the plurality of client terminals the state of each of the plurality of sub objecisibased on 
the change sequence specified by the message to reflect the change in the displayed three-dimensional virtual 
w. -reality space;.::- ■ •■• ■ t ^. ■■ «• f -* vr - : ■ ■ aw JV - ; ^ -* ; * 

wherein the computer program is readable and executable by at least one of the terminals consisting of the 
shared server terminal and the plurality, of client terminals andrthe executable computer program is: transmitted to 
at least one of the terminals consisting of J the shared server : terminal and the.plurality of client terminals. 1 - ' 

13. An information transmission method for use in a three-dimensional virtual reality space sharing system to transmit 
a computer program comprising the processing steps of :v ; * ^ .im?.- o • i ■■ *. ^ 3 - - A '= - 

connecting a plurality of. client terminals (13-1/ 13-2,; 13*3)rffbr displaying athree-dimensicffi^ 
space including an update object constituted by a plurality of .* sub i objects 1 each of which -state isi subject to 
change to a shared server terminal (11-1,11 -2) for controlling a state of the update object on each of the plu- 
^ralrty. of/client terminals* via a-Gomrriunicatioirrietwork (.15);* ^ v-o^ *. ! ■ * p * i- vf;-.?vti- 
registering in each of the plurality of client terminals in advance a change sequence tabte for banning ^'rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
- to the.state of the update object and a message fc:;specifying.a type of the change sequence;* : >' ? 
when the state oithe updateobjeci controlled by the shared 1 server terminal is updated, notifying each of the 
plurality of client terminals of the message corresponding to updated content of the state of the update object 
from the shared server terminal; and- :> <~ t r : - r; k ; ^v: I c v: . • '* :r : ; > : ^ 

changing on each of the plurality. of clien: ierminals (13-2; 13-2/13:3) the state of each of the plurality of sub 
objects based on 'he charge sequence specified 1 by the message to reflect the change iri the displayed three 
v. : : dimensional virtual reality space; * 1 5 - ^ a ? : Xr ^ - : ' - : r ^ 

wherein the computer program is readable and executable by at least one of the terminals consisting of the 
shared^erveriterminal and the plurality of client terminals: and the executable computer prograrri is transmitted to 
at least one of the terminals consisting of the shared server terminal (1 1-1; 1 1-2) and the plurality of client termi- 
nals. 

14. An information processing method of a client terminal in a three-dimensional virtual reality space sharing system 
in which a plurality of client terminals for displaying a three-dimensional virtual reality space including an update 
object constituted/by a plurality of sub objects each of which state is subject to change aire connected to a shared 
servar terminal for controlling a state of the update object on each of the plurality of client terminals via a commu- 
nication network (15), the information prc«;essing'methdd a)mprising the steps of: ' 1 ■ ::rv 
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registering^ plurality of client terminals in advance a change sequence table for- defining si rela- 

• : .tionship between asequencetpf 'changing the state of each of the plurality, of sub objects According to 3 change 
to the state of the update object and a message for specifying a type of the change sequence; i > sri: 
>:•.:.. acquiring jtfrerme^atJeL corresponding to theupdate jcontertf.*of the state of theKpdate object, tharnessage 
s ■ < • being notified feomthe shared server terrrfinal (1 U% 1 142) when the state of the update object;Ccr;tr6lled by 

the shared server terminal is updated; and ^ =" 

changing the state of each of the plurality of sub objects based on the change sequence specified by the mes- 
a >' sage tarefleet-the change in ttie dispiayed three^imensjonal v^al reality space - ' 

w 15. A client terminal in a three-dimensional virtual reality space sharing system in which a plurality of client terminals 
ifor:di6playing a thnee^rhensional virtual reality-space including an: update object constituted by a pluraiity of sub 
objects each of which state is subject to change are connected **) a shared server terminal for controlling a state of 
the update object on each of the plurality of client terminals via a communication network (15), the client terminal 
xomprisingiv \::- t •.>:.• :..-v : s: t r x W> ' ■ r - *^"v : :l ' r^:^ U ;u<z\.'o & ' 

15 vji . l:', i\: , . .;.[.,, I • v. ' c >j ' • . : ^ .-o •/■ ? > • ' vto ^ '/* 1 : v ~> ■ 

*i ;j a registering means for registering in each of the plurality .of client terminals tn advance a (change sequence 
table for defining a relationship between a sequence of< changing the state of each of the plurality of sub objects 
e.t ; according to a change to the state of the update object and "a message for specifying a type* of the change 
.' sequence; 1 v . . * tVc- r.- . o v * -\ : . . >*l>i ^ r '- ■ «; ' r. 

20 an acquiring jmeans for^ acquiring the message corresponding to the update content of the state' of the update 

, : object, the .message fbeinginbtifiedfrom the shared server terminal when the state of the update object control - 
> \: t \e&hyth& shared server terminal is updated; and .: ;: . . 7 ; ■. (>v ■■;<■;: r 1 . 

a changing means for changing the state of each of the plurality of sub objects based on the change sequence 
: • specified, by the?message tq reflect the change inttte displayed three-dimensional virtual reality space?' : 

16. An information recording medium for use in a client terminal in a three-dimensional virtual reality space 'sharing 
system to record a computer program comprising the processing steps of: 

, registering in : each oMhe plurality of client terminals in advance a change sequence table for defining a rela- 
30 tionship between a sequence.otfChanging the state of each of the plurality of sub objects according to a change 

to the state of the update object and a message for specifying a type of the change sequence; 
/*. acquiring the message corresponding to the < update content of the state of the update- object, the message 
being notified from the shared server terminal when^the state of ithe update object controlled by the shared 
server terminal is updated; and 
35 changing the state of each of the plurality of spt^objecfs based on the change sequence specified by the mes- 

a 7. sage ; to; reflect ftbec^ - % " - 

-'jk; \o v 'ic- 'vc.j ' .v^ - 1 o o^'Hr .. v.' » ■• 1 t -•" ? r ? - : • *'.:;"• ' " ^^^-S V 

wherein the computer program is recorded in the; information recording medium in a state readable and exe- 
ctrtaye by the cliern termin : i /; v . • L / ' / 

40 ^n:-'-'^ ^ l ;."*....-0'C/:::-;..;- : . \'. ; ' ; ; .< ^ *r ; . ; : ;.„.,■:•, i v r ' ^ . 

17. An information , recording method of a recording medium for use on a client terminal in a three-dimensional virtual 
t reality space sharing system to record ia computer program comprising the processing steps of : 1 ' : ■ '* '= 

registering in each of the plurality of client terminals in advance a change sequence table for defining a reia- 
45 r . ( tionship. between a sequence of changing, the state of each of the plurality -of sub objects according to a change 
o : !to the state^pf the update object and a message for specifying a type of the change sequence; . : 

acquiring the message corresponding to the update content of the state of the update object, the message 
being notified from the shared server terminal (11-1, 11-2) when the state of the update object controlled by 
c j ;the shared server terminal is updated; and v -r-r* :. - : . ; - .; v - ! •., ^: ■ 

so c : * . . changing the state of each of the plurality of sub objects based on the change sequence specified by the mes^ 
sage to ref lect the change in the displayed three-dimensional virtual^ reality space; ' * • ; v > ^ 

y • ■ 

wherein the computer program is recorded in the recording medium in a state readable and executable by 
,the client terminal.- : v r '. c ■ . ^ - ■; . ' : . * , * -■■ :: . r • ■"::v ,i ^w , / i 
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18. >An information- transmission medium for use on a client terminal in a three<iimensional virtual reality space sharing 
system in which a plurality of client terminals for displaying a three-dimensional virtual: reality space including an 
update object constituted by a plurality of sub objects each of which state is subject to change are connected toa 
shared server terminal for controlling a state of the update object on each of the plurality of client terminals (13-1 , 
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1£-2,,13;3).«yia.a communication network (15), the information transmission method transmitting 
grarn co^r|»ng%e. prj^^i^g steps of : . , , .. . ..^,. v .^*! r^-V -i',"." 1 ^sc.- 

registering in each of the plurality of client terminals in advance a change .sequence table for defining a Rela- 
tionship between a sequence of changing the state of each of the plurality of "sub objects according to a change 
to the state of. the update object and a message, for specifying a type pi the change, sequence; 
acquiring thernessaoe corresponding tothe, ui^ate, content of ^ 
. being notified from the.shared server terminal (Jl -i , 11-2) when {he stkte^ of theupdatip object controlled by 
the shared server terminal is updated; and _ } ^'7 . ,^ : /. , " / ^ l' rt . 1 \ ^ 

changing the state of each of the plurality of sub objects based on the change sequence specif ied by the mes- 
sage to ref lect the change in the display^ three-dimensional yirt^ , . v 

wherein the computer program is transmitted to the client terminal in a state' receivable and executable by 

the t same r , v i- ., v: . ta .. ,,. 5 ^ .. , ; ,,;,., T .. >: ... . , . ^ . „_ , .-.t... . . 1 ,. i:;v . ; ^ „ v vr ; 

1 9. An information transmission^ on a client terminal j'n a three-dimensional yirtuajf reality s^be'sharing 
system in which plurality of client terminals (13-1 , .13-2, 1 3-3) for displaying i a thr^e<limensiohar virtue sp&cb 
including aaupdate object constituted by a plurality of sub objects each of which state is subject to change are con- 
nected to a shared server terminal (11-1, 11-2) for controlling a state of ^e update objection Jeach of the plurality 
of client terminals via a communication network (15), the information transmission method transmitting a cortiputer 
program comprising the processing steps of : M , » , . , ^ , % 

, registering in each of theplurality of client terminals in advance a change sequence table for defining a rela- 
tionship between a sequence of changing the state of each of the plurality of sub objects according to a change 
to the state of the update object and a message for specifying a tyP e °f * h e change sequence; 

v acquiring the message corresponding to the update.content of the state of the update object, the message 
being notified from the shared server terminal (1 1-i , i 1-2)' when the state pf the update dbjea cbntrolled by 
the shared server terminal is updated; and 

changing the state of each of the plurality ( of sub objects based on the change sequence sp^crfjed by the mes- 
. sage to reflect thecbange in .the displayed three-dimensional^ \ , . . n 

wherein the computer program is transmitted to the client Jerminai in a state, receivable, and "(BXTOUtafcle^by 
the same. ^ . v -.. t ' : . x . . . ^ /,V t ^ « , >* r '\ , k ,. 'l/Si.i'\,* 

20. An information processing method of a shared server terminal in a three-dimensional virtual reality space sharing 
system in which a plurality, of client terminals: for displaying an 
update object coi^ 

shared server terminal for controlling a state pt 1h e each of the ,R|u^Wy c !>^ I^OTiais (13- 

1,13-2,13-3) via a communication network (15), the infor^ 

, -.determining update of the state of the update, object qqfltcpJI^ by r , 

when the state of the update object is updated, notifying each of the plurality of client terminals of a message 
for specifying a type of a change sequence of each of the plurality of sub objects corresponding to updated 

, content of the state of the update object from the shared s^rv^^ 

21.. AjShared server terminal in a thre^dimensipnal virtual reality space sharing system in which a plurality of client ter- 
minals (13-1, 13-2, 13^3) for displaying a thr^rdiipe^ 

tuted ; by a. plurality pf sub < objects each of which state js subject to change are connecrtpd to. a sh^'ed'^efyer 
terminal for controlling a state of the update object on each of the plurality of client terminals via a communication 
network, the shared server terminal comprising: 

a determining means for determining, update. of the state of the update object controlled by thie shared server 
. - terminal; and ;J< ^ t . , ; . . . • -< ■■ . : .. -......'..-I, ; .-,. iir(> il ,.;. . . ,* s . ~ . . ftt . . , f ^- 

when the state of the update object is updated, a notifying means for notifying each of the plurality "of client ter- 
minals of a message for specifying a type of a change sequence of each of the plurality df sub objects corre- 
sponding to updated content of the state of the update object from the shared, server terminal 0.1-1, , 1 1 -2). 

22. An information recording medium for use on a shared server terminal in a three-dimensional virtual reality space 
sharing system in which a plurality of client terminals for displaying a three<limensional virtual reality space includ- 
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ing i an up&ia?e object constituted Iby a plurality of sub objects each of which state is subject to Change are ( bonnected 
to a shared server terminal for controlling a state of the update object on each of the'fbluralrty of client terminals (13- 
1,13-2 13-3) via a communication network (15), the information recording medium recording a computer program 
comprising [the r5r6c&feirig steps : 6f: - *" ! ' r ,ff ' ; r - ; -I ^ . 

^ , deterrrjinin'g update. of the state of. the update object controlled by the shared server terminal; and 
J. - : whVn"the state of ^ each of the plurality of client terminals cf a message 

for specifying a type of a change sequence of each of the plurality of sub f objects correspbnding'to updated 
ir content. of ; the st£te of the update object from the shared server terminal (11 -1 / 1 1-2); ! ~ ' : 

wherein the computer jjrogram is stored in the information recording medfurh irVa state readable arid exe- 
cutable by the, shared server terminal. 

23. An information recording method for use on a shared server terminal in a three-dimensional virtual reality space 
sharing system jn which a plurality of client terminals for displaying a three-dimensional virtual reality space includ- 
ing "an update object constituted by a plurality pf sub objects each of whidh state 1 is subject to change arie connected 
to a ! shared server terminal for controlling a state of the ujxiate object on eath of the plurality of client terminals via 
. a communication riejtoqrk (15), the informjaiibn recording method rieciording a cpmputer program cbmp'rising of the 
processing steps of : * ...^ i'"' ' '''' " ' ' V '* J . 'V 

determining update of the state of the update object controlled by the shared server terminal; and 1 ' 1 * " s 
when the .state of the update object is updated, notifying each of the plurality of client terminals (13-1, 13-2, 13- 
3) "of a message; for specifying a type of acharige sequence of each' bf the plurality of sub bbjecte correspond- 
ing to updated content of the state 6 : 



j 

cor 

able by the shared 



wHereiriihe computer prbcjram is Stored iri an information recording medium in a state readable and execut- 
hared server termihar(Vl-i; ii-2) " \" ' ' ; - ! - 



24. An irifbrrnatidri transmission m^ium for use on a shared server terminal in a three-dimensional virtual reality space 
30 sharing system in which a plurality of client terrVtirials for displaying a three-dimensional virtual reality space includ- 

ing,an ( update object constituted by a plurality of sub pbjepts each of which state is subject to change are connected 
to a sharied Server terminal (TT-1 . 11 : 2) for controlling a state of the update object on' each of the plurality of client 
terminals via a communication network (15), the information transmission medium transmitting a computer pro- 
gram comprising the^oce^sing steps of: . . ,- ( .. v . 

35 r.v^'-u / .v.. .."."*"! l: " " . * * : * : r ; '" ■ ** *' ,v * ■■" v 1 * ' ' ' ; 

^ r ; determ^ of tbe [ State of the u^Se^objeci controlled by the sharedserver terminal; and f r 

V.' Whei^ notifying each of the plurality of client- terminals of a message 

' for ^ specifying a ty^e of a ^ the plurality of sub ' objects correspbridirig to updated 

cohteriVbf the ^ate bhhe u^^ " ; " r : " j 

40 

wherein thecbmbu^ server terminal in a state receivable arid execut- 

^^ile by ^e'wme?. 1 r> '■ 0 ! ^'^,^' i:tl ' ' ' ' y ' ' : " ; * ; ' ; ' ' '* 

25. An information transmission method for use on a shared server terminal in a three-dimensioriai virtual reality space 
45 sharing system in which a plurality of client terminals (13-1, 13-2, 13-3) for displaying a three-dimensional virtual 

reality space including an update object constituted by a plurality of sub objects each of which state-is subject to 
change are c^hnected to a shsired server/terminal lor cbrifroiiirig a state of the urjdatie object on each of the plurality 
^ of cNent terminals, vi^ tfie information transmission method transmitting a corripLrter 

prc^ram domprising' the pr&e'ssing Steps' of: >! ■ - * ^ • r 1 



determining update of the state of the update object controlled by the shared server terminal; and 
'when the state of the updiate ofject is 'updated, /notifying each of theplurality of cfient terminals (1 3-1 , 13-2, 13- 
3) of a message for specifying a type of a change sequence of each of the plurality of sub objects correspond- 
ing to updated content of the state of the update object from the shared server terminal; " ■ 

* ' wh erein the computer program is trarismittiEsd to the shared server terminal in a state receivab! e and execut- 
able by t the same. 
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(54) A three-dimensional virtual reality space sharing method and system 



(57) Volume of communication necessary for dis- 
playing moving images is minimized. When an object is 
moved on a client terminal (13-1), a message indicating 
the movement of the object is transmitted to a server 
terminal (11-1). The server terminal (11-1) transmits the 
message to client terminals (13-2 and 13-3). Each of 
the client terminals (13-1) through (13-3) stores a mes- 
sage table in advance to execute the message. Accord- 
ing the message table, an image for locally moving an 



object (101) is generated and displayed. This novel 
setup transmits information about the update of an 
update objects composed ol a plurality of sub objects 
each of which state is subject to change, in a minimum 
transmission volume. This, in turn, allows cooperative 
operations of the plurality of sub objects to be smoothly 
displayed in a three-dimensional virtual reality space 
shared by a plurality of users. 
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